Decoding device and decoding method, encoding device, and encoding method

ABSTRACT

The present disclosure relates to a decoding device, a decoding method, an encoding device, and an encoding method, which are capable of enabling a decoding side to accurately recognize a color gamut of an encoding target image. The decoding device includes circuitry configured to receive an encoded stream including encoded data of an image and color primary information indicating a coordinate of at least one color primary of the image. The circuitry extracts the encoded data and the color primary information from the received encoded stream. The circuitry decodes the encoded data to generate the image. Further, the circuitry adjusts a color space of the generated image based on the extracted color primary information. The present disclosure can be applied to, for example, a decoding device of a high efficiency video coding (HEVC) scheme.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. patent application Ser. No.14/984,509, filed Dec. 30, 2015, which is a continuation of U.S. patentapplication Ser. No. 14/490,444, filed Sep. 18, 2014, which is acontinuation of PCT/JP2014/072104 filed on Aug. 25, 2014 and claimspriority to Japanese Patent Application Nos. 2013-182578 filed Sep. 3,2013 and 2013-272944 filed Dec. 27, 2013, the entire contents of each ofwhich are incorporated herein by reference.

TECHNICAL FIELD

The present disclosure relates to a decoding device, a decoding method,an encoding device, and an encoding method, and more particularly, adecoding device, a decoding method, an encoding device, and an encodingmethod, which are capable of enabling a decoding side to accuratelyrecognize a color gamut of an encoding target image.

BACKGROUND ART

In recent years, devices complying with a scheme such as a MovingPicture Experts Group phase (MPEG) in which compression is performed byorthogonal transform such as discrete cosine transform (DCT) and motioncompensation using specific redundancy of image information have beenspread for both information delivery of broadcasting stations or thelike and information reception in general households.

Particularly, an MPEG 2 (ISO/IEC 13818-2) scheme is defined as ageneral-purpose image coding scheme, and now being widely used for awide range of applications of professional use and consumer use as astandard converting an interlaced scanned image, a progressive scannedimage, a standard resolution image, and a high-definition image. Usingthe MPEG 2 scheme, for example, a high compression rate and an excellentimage quality can be implemented by allocating a bit rate of 4 to 8 Mbpsin the case of an interlaced scanned image of a standard resolutionhaving 720×480 pixels and a bit rate of 18 to 22 MBps in the case of aninterlaced scanned image of a high resolution having 1920×1088 pixels.

The MPEG 2 mainly aims for high-quality encoding suitable forbroadcasting, but does not support a coding scheme of a bit rate lowerthan that of MPEG 1, that is, a coding scheme of a high compressionrate. As mobile terminals are spread, a need for such a coding schemehas been considered to increase in the near future, and accordingly anMPEG 4 coding scheme has been standardized. ISO/IEC 14496-2 has beenapproved as an international standard for the MPEG4 image coding schemein December, 1998.

Further, in recent years, standardization of a standard such as H.26L(ITU-T Q6/16 VCEG) designed for image coding for video conferencing atfirst is being conducted. Although H.26L is known to require a morecomputation amount for encoding and decoding than in a coding schemesuch as MPEG 2 or MPEG 4, H.26L is also known to be able to implementhigh coding efficiency.

Further, in recent years, as one of MPEG 4 activities, standardizationof incorporating a function that is not supported by H.26L based onH.26L and implementing high coding efficiency has been conducted asJoint Model of Enhanced-Compression Video Coding. This standardizationhas been approved in the name of H.264 or MPEG-4 Part 10 (Advanced VideoCoding (AVC)) in March, 2003.

Furthermore, as an extension thereof, Fidelity Range Extension (FRExt)including an encoding tool necessary for professional use such as RGB orYUV422 or YUV444 or 8×8 DCT and a quantization matrix which arespecified in MPEG-2 has been standardized in February, 2005. As aresult, the AVC scheme has become a coding scheme capable of alsoexpressing a film noise included in a movie well and is being used in awide range of applications such as a BD (Blu-ray (a registeredtrademark) Disc).

However, in recent years, there is an increasing need for highcompression rate coding capable of compressing an image of about4000×2000 pixels which are 4 times as high as a high-definition image ordelivering a high-definition image in a limited transmission capacityenvironment such as the Internet. To this end, an improvement in codingefficiency has been under continuous review by Video Coding Expert Group(VCEG) under ITU-T.

Currently, in order to further improve coding efficiency to be higherthan in the AVC, standardization of a coding scheme called HighEfficiency Video Coding (HEVC) has been being conducted by JointCollaboration Team-Video Coding (JCTVC) which is a joint standardizationorganization of ITU-T and ISO/IEC. Non Patent Document 1 has been issuedas a draft as of August, 2013.

Meanwhile, in the AVC scheme and the HEVC scheme, a color gamut of anencoding target image is defined by colour_primaries of video usabilityinformation (VUI).

CITATION LIST Non Patent Document

-   Non Patent Document 1: Benjamin Bross, Gary J. Sullivan, Ye-Kui    Wang, “Editors' proposed corrections to HEVC version 1,”    JCTVC-M0432_v3, 2013 Apr. 18-Apr. 26

SUMMARY OF THE INVENTION Problems to be Solved by the Invention

However, a color gamut of an encoding target image is defined by anindex identifying any one of color gamuts defined in another standard.Thus, it is difficult to define a color gamut other than a fixed colorgamut as a color gamut of an encoding target image, and it is difficultto accurately recognize a color gamut of an encoding target image at adecoding side.

The present disclosure was made in light of the foregoing, and it isdesirable to enable a decoding side to accurately recognize a colorgamut of an encoding target image.

Solutions to Problems

A decoding device according to a first aspect of the present disclosureincludes: a receiving unit that receives an encoded stream includingencoded data of an image and color gamut information indicating a colorgamut of the image from an encoding device that transmits the encodedstream; an extracting unit that extracts the encoded data and the colorgamut information from the encoded stream received by the receivingunit; and a decoding unit that decodes the encoded data extracted by theextracting unit, and generates the image.

A decoding method according to the first aspect of the presentdisclosure corresponds to the decoding device according to the firstaspect of the present disclosure.

In the first aspect of the present disclosure, an encoded streamincluding encoded data of an image and color gamut informationindicating a color gamut of the image is received from an encodingdevice that transmits the encoded stream, the encoded data and the colorgamut information are extracted from the encoded stream, and the encodeddata is decoded to generate the image.

An encoding device according to a second aspect of the presentdisclosure includes: an encoding unit that encodes an image, andgenerates encoded data; a setting unit that sets color gamut informationindicating a color gamut of the image; and a transmitting unit thattransmits an encoded stream including the encoded data generated by theencoding unit and the color gamut information generated by the settingunit.

An encoding method according to the second aspect of the presentdisclosure corresponds to the encoding device according to the secondaspect of the present disclosure.

In the second aspect of the present disclosure, an image is encoded togenerate encoded data, color gamut information indicating a color gamutof the image is set, and an encoded stream including the encoded dataand the color gamut information is transmitted.

A decoding device according to a third aspect of the present disclosureincludes: a receiving unit that receives an encoded stream includingencoded data of an image, identification information identifying acertain color gamut, and a cover ratio of a color gamut of the image tothe certain color gamut from an encoding device that transmits theencoded stream; an extracting unit that extracts the encoded data, theidentification information, and the cover ratio from the encoded streamreceived by the receiving unit; and a decoding unit that decodes theencoded data extracted by the extracting unit, and generates the image.

A decoding method according to the third aspect of the presentdisclosure corresponds to the decoding device according to the thirdaspect of the present disclosure.

In the third aspect of the present disclosure, an encoded streamincluding encoded data of an image, identification informationidentifying a certain color gamut, and a cover ratio of a color gamut ofthe image to the certain color gamut is received from an encoding devicethat transmits the encoded stream, the encoded data, the identificationinformation, and the cover ratio are extracted from the encoded stream,and the encoded data is decoded to generate the image.

An encoding device according to a fourth aspect of the presentdisclosure includes: an encoding unit that encodes an image andgenerates encoded data; a setting unit that sets identificationinformation identifying a certain color gamut and a cover ratio of acolor gamut of the image to the certain color gamut; and a transmittingunit that transmits an encoded stream including the encoded datagenerated in the encoding unit and the identification information andthe cover ratio generated in the setting unit.

An encoding method according to the fourth aspect of the presentdisclosure corresponds to the encoding device according to the fourthaspect of the present disclosure.

In the fourth aspect of the present disclosure, an image is encoded togenerate encoded data, identification information identifying a certaincolor gamut and a cover ratio of a color gamut of the image to thecertain color gamut are set, and an encoded stream including the encodeddata, the identification information, and the cover ratio istransmitted.

The decoding devices according to the first and third aspects and theencoding devices according to the second and fourth aspects may beimplemented by causing a computer to execute a program.

The program executed by the computer to implement the decoding devicesaccording to the first and third aspects and the encoding devicesaccording to the second and fourth aspects may be provided such that theprogram is transmitted via a transmission medium or recorded in arecording medium.

A decoding device according to a fifth aspect of the present disclosureincludes: circuitry configured to receive an encoded stream includingencoded data of an image and color primary information indicating acoordinate of at least one color primary of the image; extract theencoded data and the color primary information from the received encodedstream; decode the extracted encoded data to generate the image based onthe decoded data; and adjust a color space of the generated image basedon the extracted color primary information.

A decoding method according to the fifth aspect of the presentdisclosure corresponds to the decoding device according to the fifthaspect of the present disclosure.

In the fifth aspect of the present disclosure, an encoded streamincluding encoded data of an image and color primary informationindicating a coordinate of at least one color primary of the image isreceived, the encoded data and the color primary information areextracted by circuitry of the decoding device from the received encodedstream, the encoded data is decoded to generate the image, and a colorspace of the image is adjusted by the circuitry based on the extractedcolor primary information.

A non-transitory computer-readable medium according to a sixth aspect ofthe present disclosure has stored thereon: an encoded stream includingencoded data of an image and color primary information indicating acoordinate of at least one color primary of the image, wherein adecoding device decodes the encoded data to generate the image, andadjusts a color space of the generated image based on the color primaryinformation.

An encoding device according to a seventh aspect of the presentdisclosure includes: circuitry configured to encode an image; generateencoded data; set color primary information indicating a coordinate ofat least one color primary of the image; and transmit an encoded streamincluding the generated encoded data and the generated color primaryinformation.

The decoding device according to the first, third, or fifth aspect andthe encoding device according to the second, fourth, or seventh aspectmay be an independent device or may be an internal block configuring asingle device.

Effects of the Invention

According to the first and third aspects of the present disclosure, itis possible to decode encoded data of an image. Further, according tothe first and third aspects of the present disclosure, it is possible toaccurately recognize a color gamut of an encoding target image.

Further, according to the second and fourth aspects of the presentdisclosure, it is possible to encode an image. Further, according to thesecond and fourth aspects of the present disclosure, it is possible toenable a decoding side to accurately recognize a color gamut of anencoding target image.

The effects described above are not necessarily limited, and may includeany effect described in the present disclosure.

BRIEF DESCRIPTION OF DRAWINGS

FIG. 1 is a block diagram illustrating an exemplary configuration of anencoding device according to a first embodiment of the presentdisclosure.

FIG. 2 is a diagram illustrating an exemplary syntax of acolour_primaries_info SEI.

FIG. 3 is a diagram for describing content of information of thecolour_primaries_info SEI.

FIG. 4 is a diagram for describing content of information of thecolour_primaries_info SEI.

FIG. 5 is a diagram illustrating an exemplary syntax ofcolour_primaries_info_sei_element.

FIG. 6 is a diagram for describing content of information ofcolour_primaries_info_sei_element.

FIG. 7 is a diagram for describing content of information ofcolour_primaries_info_sei_element.

FIG. 8 is a diagram illustrating an exemplary syntax of aref_display_luminance_info SEI.

FIG. 9 is a diagram for describing content of information of theref_display_luminance_info SEI.

FIG. 10 is a flowchart for describing a stream generation process of anencoding device.

FIG. 11 is a block diagram illustrating an exemplary configuration of adecoding device according to the first embodiment of the presentdisclosure.

FIG. 12 is a flowchart for describing an image generation process of thedecoding device of FIG. 11.

FIG. 13 is a block diagram illustrating an exemplary configuration of anencoding device according to a second embodiment of the presentdisclosure.

FIG. 14 is a diagram illustrating an exemplary syntax of acolour_primaries_info SEI.

FIG. 15 is a diagram for describing information of thecolour_primaries_info SEI.

FIG. 16 is a diagram for describing information of thecolour_primaries_info SEI.

FIG. 17 is a diagram for describing information of thecolour_primaries_info SEI.

FIG. 18 is a diagram for describing information of thecolour_primaries_info SEI.

FIG. 19 is a diagram for describing information of thecolour_primaries_info SEI.

FIG. 20 is a flowchart for describing a stream generation process of anencoding device.

FIG. 21 is a block diagram illustrating an exemplary configuration of adecoding device according to the second embodiment of the presentdisclosure.

FIG. 22 is a flowchart for describing an image generation process of thedecoding device of FIG. 21.

FIG. 23 is a diagram for describing an MP4 box as a system layer inwhich color gamut information and luminance information are arranged.

FIG. 24 is a block diagram illustrating an exemplary hardwareconfiguration of a computer.

FIG. 25 is a diagram illustrating an exemplary multi-view image codingscheme.

FIG. 26 is a diagram illustrating an exemplary configuration of amulti-view image encoding device to which the present disclosure isapplied.

FIG. 27 is a diagram illustrating an exemplary configuration of amulti-view image decoding device to which the present disclosure isapplied.

FIG. 28 is a diagram illustrating an exemplary scalable image codingscheme.

FIG. 29 is a diagram for describing exemplary spatial scalable coding.

FIG. 30 is a diagram for describing exemplary temporal scalable coding.

FIG. 31 is a diagram for describing exemplary scalable coding of asignal-to-noise ratio.

FIG. 32 is a diagram illustrating an exemplary configuration of ascalable image encoding device to which the present disclosure isapplied.

FIG. 33 is a diagram illustrating an exemplary configuration of ascalable image decoding device to which the present disclosure isapplied.

FIG. 34 is a diagram illustrating an exemplary schematic configurationof a television device to which the present disclosure is applied.

FIG. 35 is a diagram illustrating an exemplary schematic configurationof a mobile telephone to which the present disclosure is applied.

FIG. 36 is a diagram illustrating an exemplary schematic configurationof a recording/reproducing device to which the present disclosure isapplied.

FIG. 37 is a diagram illustrating an exemplary schematic configurationof an imaging device to which the present disclosure is applied.

FIG. 38 is a block diagram illustrating a scalable coding applicationexample.

FIG. 39 is a block diagram illustrating another scalable codingapplication example.

FIG. 40 is a block diagram illustrating another scalable codingapplication example.

FIG. 41 illustrates an exemplary schematic configuration of a video setto which the present disclosure is applied.

FIG. 42 illustrates an exemplary schematic configuration of a videoprocessor to which the present disclosure is applied.

FIG. 43 illustrates another exemplary schematic configuration of a videoprocessor to which the present disclosure is applied.

MODE FOR CARRYING OUT THE INVENTION First Embodiment

(Exemplary Configuration of Encoding Device According to FirstEmbodiment)

FIG. 1 is a block diagram illustrating an exemplary configuration of anencoding device according to a first embodiment of the presentdisclosure.

An encoding device 10 of FIG. 1 includes a setting unit 11, an encodingunit 12, and a transmitting unit 13, and encodes an image according to ascheme based on the HEVC scheme.

Specifically, the setting unit 11 of the encoding device 10 setsparameter sets such as a sequence parameter set (SPS), a pictureparameter set (PPS), a VUI, and a supplemental enhancement information(SEI).

Examples of the SEI include a colour_primaries_info SEI, aref_display_luminance_info SEI, and the like. The colour_primaries_infoSEI is an SEI including color gamut information indicating a (boundaryof) a color gamut. The ref_display_luminance_info SEI is an SEIincluding luminance information (color gamut information of a masterdisplay) indicating luminance levels of white, gray, and black of themaster display (display unit) that displays an encoding target image atthe time of authoring of the encoding target image. The setting unit 11provides the set parameter sets to the encoding unit 12.

The encoding target image is input to the encoding unit 12 in units offrames. The encoding unit 12 encodes the input encoding target imageaccording to the HEVC scheme. The encoding unit 12 generates an encodedstream based on encoded data obtained as a result of encoding and theparameter sets provided from the setting unit 11, and provides theencoded stream to the transmitting unit 13.

The transmitting unit 13 transmits the encoded stream provided from theencoding unit 12 to a decoding device which will be described later.

(Exemplary Syntax of Colour_Primaries_Info SEI)

FIG. 2 is a diagram illustrating an exemplary syntax of thecolour_primaries_info SEI.

As illustrated in a second line of FIG. 2, colour_primaries_info_id isdescribed in the colour_primaries_info SEI. As illustrated in FIG. 3,colour_primaries_info_id is an ID identifying the purpose of the colorgamut information.

As illustrated in a third line of FIG. 2, colour_primaries_type isdescribed in the colour_primaries_info SEI. As illustrated in FIG. 3,colour_primaries_type indicates a color space type. For example, asillustrated in a table of FIG. 3, colour_primaries_type is 1 when acolor space type is an RGB color coordinate system, andcolour_primaries_type is 2 when a color space type is an XYZ colorcoordinate system.

As illustrated in a fourth line of FIG. 2,colour_primaries_info_present_flag is described in thecolour_primaries_info SEI. As illustrated in FIG. 3,colour_primaries_info_present_flag is a flag indicating whether or notprimary color information indicating a position of the primary color inthe color space in the color gamut information is described in thecolour_primaries_info SEI. colour_primaries_info_present_flag is 1 whenthe primary color information is described, andcolour_primaries_info_present_flag is 0 when the primary colorinformation is not described.

As illustrated in a fifth line of FIG. 2, white_point_info_present_flagis described in the colour_primaries_info SET. As illustrated in FIG. 3,white_point_info_present_flag is a flag indicating whether or not whiteinformation indicating a position (white point) of white in the colorspace in the color gamut information is described in thecolour_primaries_info SEI. White_point_info_present_flag is 1 when thewhite information is described, and white_point_info_present_flag is 0when the white information is not described.

As illustrated in sixth and seventh lines of FIG. 2, whencolour_description_present_flag included in a VUI is 1,limited_colour_gamut_boundaries_flag is described in thecolour_primaries_info SET. Further, colour_description_present_flag is aflag indicating whether or not an index identifying a color gamutdefined in a VUI in another standard is described.Colour_description_present_flag is 1 when an index is described in aVUI, and colour_description_present_flag is 0 when an index is notdescribed in a VUI.

Further, limited_colour_gamut_boundaries_flag is a flag indicatingwhether or not a color gamut of an encoding target image is limited to acolor gamut identified by an index described in a VUI as illustrated inFIG. 4. Limited_colour_gamut_boundaries_flag is 0 when a color gamut islimited, and limited_colour_gamut_boundaries_flag is 1 when a colorgamut is not limited.

As illustrated in eighth and ninth lines of FIG. 2, whenlimited_colour_gamut_boundaries_flag is 1,limited_colour_gamut_range_in_percent is described in thecolour_primaries_info SEI. As illustrated in FIG. 4,limited_colour_gamut_range_in_percent indicates a cover ratio of a colorgamut of an encoding target image to a color gamut identified by anindex described in a VUI. In other words,limited_colour_gamut_range_in_percent is a ratio of a color gamut of anencoding target image to a color gamut identified by an index describedin a VUI.

As illustrated in tenth and eleventh lines of FIG. 2, whencolour_primaries_info_present_flag is 1, colour_primaries_order_type isdescribed in the colour_primaries_info SEI. As illustrated in FIG. 4,colour_primaries_order_type is a type of a description order of theprimary color information.

For example, as illustrated in a table of FIG. 4, when the color spacetype is the RGB color coordinate system, the primary color informationis described in the order of red, green, and blue, red, green, and blue,and then described in the descending order of wavelengths of the othercolors (for example, the order of yellow and cyan),colour_primaries_order_type is 1. Further, when the color space type isthe RGB color coordinate system and the primary color information isdescribed in the descending order of wavelengths (for example, the orderof red, yellow, green, cyan, and blue), colour_primaries_order_type is2. When the color space type is the XYZ color coordinate system and theprimary color information is described in the order of X, Y, and Z,colour_primaries_order_type is 3.

Further, as illustrated in a twelfth line of FIG. 2, whencolour_primaries_info_present_flag is 1, num_colour_primaries_minus3 isdescribed in the colour_primaries_info SEI. As illustrated in FIG. 4,num_colour_primaries_minus3 is a value obtained by subtracting threefrom the number of pieces of primary color information described in thecolour_primaries_info SEI.

As illustrated in thirteenth and sixteenth lines of FIG. 2, whencolour_primaries_info_present_flag is 1, primary color information isdescribed in the colour_primaries_info SEI by the number obtained byadding three to num_colour_primaries_minus3. The primary colorinformation includes colour_primaries_info_sei_element(ColourPrimaryXSign[i], ColourPrimaryXExp[i], ColourPrimaryXMantissa[i],and ColourPrimaryXManlen[i]) indicating positions of primary colors inan X direction in the color space and colour_primaries_info_sei_element(ColourPrimaryYSign[i], ColourPrimaryYExp[i], ColourPrimaryYMantissa[i],and ColourPrimaryYManlen[i]) indicating positions in a Y direction.

As illustrated in seventeenth to nineteenth lines of FIG. 2, whenwhite_point_info_present_flag is 1, white information is described inthe colour_primaries_info SEI.

The white information includes colour_primaries_info_sei_element(WhitePointXSign, WhitePointXExp, WhitePointXMantissa,WhitePointXManlen) indicating a position of white in the X direction inthe color space and colour_primaries_info_sei_element (WhitePointYSign,WhitePointYExp, WhitePointYMantissa, WhitePointYManlen) indicating aposition in the Y direction.

(Exemplary Syntax of Colour_Primaries_Info_Sei_Element)

FIG. 5 is a diagram illustrating an exemplary syntax ofcolour_primaries_info_sei_element configuring the primary colorinformation and the white information.

As illustrated in FIG. 5, colour_primaries_info_sei_element includescolour_primaries_info_sign, colour_primaries_info_exponent,colour_primaries_info_mantissa_len_minus1, andcolour_primaries_info_mantissa.

In FIG. 5, ColourPrimaryXSign[i], ColourPrimaryYSign[i],WhitePointXSign, and WhitePointYSign are referred to collectively as“OutSign.” Similarly, ColourPrimaryXExp[i], ColourPrimaryYExp[i],WhitePointXExp, and WhitePointYExp are referred to collectively as“OutExp,” and ColourPrimaryXMantissa[i], ColourPrimaryYMantissa[i],WhitePointXMantissa, and WhitePointYMantissa are referred tocollectively as “OutMantissa.” Further, ColourPrimaryXManlen[i],ColourPrimaryYManlen[i], WhitePointXManlen, and WhitePointYManlen arereferred to collectively as “OutManLen.”

As illustrated in FIG. 6, colour_primaries_info_sign indicates a sign ofa floating point of coordinates a position of a corresponding color in acolor space. colour_primaries_info_sign is 0 when the sign is positive,and colour_primaries_info_sign is 1 when the sign is negative.

As illustrated in FIG. 6, colour_primaries_info_exponent indicates anexponent of a floating point of coordinates a position of acorresponding color in a color space.

As illustrated in FIG. 6, colour_primaries_info_mantissa_len_minus1 is avalue obtained by subtracting 1 from the number of bits ofcolour_primaries_info_mantissa. As illustrated in FIG. 6,colour_primaries_info_mantissa is a mantissa of a floating point ofcoordinates of a position of a corresponding color in a color space.

As described above, colour_primaries_info_sei_element can indicatecoordinates x of a position of a corresponding color in a color space.In other words, as illustrated in FIG. 7, the coordinates x can beobtained by the following Equations (1) usingcolour_primaries_info_sign, colour_primaries_info_exponent,colour_primaries_info_mantissa_len_minus1, andcolour_primaries_info_mantissa.[Mathematical Formula 1]If o<e<127,x=(−1)^(s)*2^(c-31)*(1+n÷2^(V))If e=0,x=(−1)^(s)*2^(−(30+V)) *n  (1)

In Equation (1), s denotes colour_primaries_info_sign, and e indicatescolour_primaries_info_exponent. Further, n denotescolour_primaries_info_mantissa, and v denotescolour_primaries_info_mantissa_len_minus1.

For example, when colour_primaries_info_sei_element iscolour_primaries_info_sei_element (ColourPrimaryXSign[i],ColourPrimaryXExp[i], ColourPrimaryXMantissa[i], andColourPrimaryXManlen[i]) indicating coordinates ColourPrimariesX of theprimary colors in the x direction in the color space,ColourPrimariesXSign that is colour_primaries_info_sign ofcolour_primaries_info_sei_element (ColourPrimaryXSign[i],ColourPrimaryXExp[i], ColourPrimaryXMantissa[i], andColourPrimaryXManlen[i]) is substituted into s of Equation (1) asillustrated in a table of FIG. 7.

Further, ColourPrimariesXExp that is colour_primaries_info_exponent ofcolour_primaries_info_sei_element (ColourPrimaryXSign[i],ColourPrimaryXExp[i], ColourPrimaryXMantissa[i], andColourPrimaryXManlen[i]) is substituted into e of Equation (1).Furthermore, ColourPrimaryXMantissa that iscolour_primaries_info_mantissa of colour_primaries_info_sei_element(ColourPrimaryXSign[i], ColourPrimaryXExp[i], ColourPrimaryXMantissa[i],and ColourPrimaryXManlen[i]) is substituted into n of Equation (1), andColourPrimaryXManlen that is colour_primaries_info_mantissa_len_minus1is substituted into v. Thus, coordinates ColourPrimariesX of thepositions of the primary colors in the x direction in the color spaceare calculated as the coordinates x.

Similarly, when colour_primaries_info_sei_element iscolour_primaries_info_sei_element (ColourPrimaryYSign[i],ColourPrimaryYExp[i], and ColourPrimaryYMantissa[i],ColourPrimaryYManlen[i]), coordinates ColourPrimariesY of the positionsof the primary colors in the y direction in the color space arecalculated as the coordinates x.

When colour_primaries_info_sei_element iscolour_primaries_info_sei_element (WhitePointXSign, WhitePointYExp,WhitePointXMantissa, and WhitePointXManlen), coordinates WhitePointX ofthe position of white in the x direction in the color space arecalculated as the coordinates x.

When colour_primaries_info_sei_element iscolour_primaries_info_sei_element (WhitePointYSign, WhitePointYExp,WhitePointYMantissa, and WhitePointYManlen), coordinates WhitePointY ofthe position of white in the y direction in the color space arecalculated as the coordinates x.

(Exemplary Syntax of Ref_Display_Luminance_Info SEI)

FIG. 8 is a diagram illustrating an exemplary syntax of theref_display_luminance_info SEI.

As illustrated in a second line of FIG. 8, ref_display_luminance_info_idis described in the ref_display_luminance_info SEI. As illustrated inFIG. 9, ref_display_luminance_info_id an ID identifying the purpose ofluminance information of white, gray, and black of the master display(reference display).

As illustrated in a third line of FIG. 8,ref_display_luminance_white_present_flag is described in theref_display_luminance_info SEI. As illustrated in FIG. 9,ref_display_luminance_white_present_flag is a flag indicating whether ornot luminance information of white of the master display is described inthe ref_display_luminance_info SEI. When the luminance information ofwhite of the master display is described in theref_display_luminance_info SEI, ref_display_luminance_white_present_flagis 1, and when the luminance information of white of the master displayis not described in the ref_display_luminance_info SEI,ref_display_luminance_white_present_flag is 0.

As illustrated in fourth and fifth lines of FIG. 8, even for black andgray, similarly, ref_display_luminance_black_present_flag andref_display_luminance_gray_present_flag are described in theref_display_luminance_info SEI.

Further, as illustrated in sixth and seventh lines of FIG. 8, whenref_display_luminance_white_present_flag is 1,ref_display_luminance_white is described in theref_display_luminance_info SEI. As illustrated in FIG. 9,ref_display_luminance_white is luminance information of white.

As illustrated in eighth and ninth lines of FIG. 8, for black,similarly, when ref_display_luminance_black_present_flag is 1,ref_display_luminance_black serving as luminance information of black isdescribed in the ref_display_luminance_info SEI.

Further, as illustrated in tenth and eleventh lines of FIG. 8, even forgray, similarly, when ref_display_luminance_gray_present_flag is 1,ref_display_luminance_gray serving as luminance information of gray isdescribed in the ref_display_luminance_info SEI.

(Description of Processing of Encoding Device)

FIG. 10 is a flowchart for describing a stream generation process of theencoding device 10.

In step S11 of FIG. 10, the setting unit 11 of the encoding device 10sets an SPS. In step S12, the setting unit 11 sets a VUI including anindex (identification information) identifying a color gamut defined inanother standard.

In step S13, the setting unit 11 sets a PPS. In step S14, the settingunit 11 determines whether or not a color gamut of an encoding targetimage is narrower than a color gamut identified by the index included inthe VUI.

When it is determined in step S14 that the color gamut of the encodingtarget image is narrower than the color gamut identified by the indexincluded in the VUI, the process proceeds to step S15. In step S15, thesetting unit 11 sets the colour_primaries_info SEI including color gamutinformation of the encoding target image, and the process proceeds tostep S16.

Meanwhile, when it is determined in step S14 that the color gamut of theencoding target image is not narrower than the color gamut identified bythe index included in the VUI, the colour_primaries_info SEI includingthe color gamut information of the encoding target image is not set. Forexample, the colour_primaries_info SEI includinglimited_colour_gamut_range_in_percent is set. Then, the process proceedsto step S16.

In step S16, the setting unit 11 sets the ref_display_luminance_info SEIincluding the luminance information of white, gray, and black of themaster display. The setting unit 11 provides the parameter sets such asthe set SPS, the PPS, the VUI, the colour_primaries_info SEI, and theref_display_luminance_info SEI to the encoding unit 12.

In step S17, the encoding unit 12 encodes an encoding target image offrame units input from the outside according to the HEVC scheme. In stepS18, the encoding unit 12 generates encoded stream based on encoded dataobtained as a result of encoding and the parameter sets provided fromthe setting unit 11, and provides the encoded stream to the transmittingunit 13.

In step S19, the transmitting unit 13 transmits the encoded streamprovided from the encoding unit 12 to the decoding device which will bedescribed later, and then the process ends.

As described above, the encoding device 10 sets and transmits thecolour_primaries_info SEI including the color gamut information, andthus even when an encoding target image has a color gamut different froma color gamut defined in another standard, it is possible to enable thedecoding side to accurately recognize a color gamut of an encodingtarget image.

Further, the encoding device 10 sets and transmits theref_display_luminance_info SEI including the luminance information ofwhite, black, and gray, and thus it is possible to enable the decodingside to recognize the luminance information of the master display.

The above description has been made in connection with the example inwhich the colour_primaries_info SEI including the color gamutinformation is set when the color gamut of the encoding target image isnarrower than the color gamut identified by the index included in theVUI, but the colour_primaries_info SEI including the color gamutinformation may be set when the color gamut of the encoding target imageis broader than the color gamut identified by the index included in theVUI.

(Exemplary Configuration of Decoding Device According to FirstEmbodiment)

FIG. 11 is a block diagram illustrating an exemplary configuration of adecoding device that decodes the encoded stream transmitted from theencoding device 10 of FIG. 1 according to the first embodiment of thepresent disclosure.

A decoding device 50 of FIG. 11 includes a receiving unit 51, anextracting unit 52, a decoding unit 53, an adjusting unit 54, a displaycontrol unit 55, and a display unit 56.

The receiving unit 51 of the decoding device 50 receives the encodedstream transmitted from the encoding device 10 of FIG. 1, and providesthe encoded stream to the extracting unit 52.

The extracting unit 52 extracts parameter sets and encoded data from theencoded stream provided from the receiving unit 51. The extracting unit52 provides the parameter sets and the encoded data to the decoding unit53. Further, the extracting unit 52 provides the VUI, thecolour_primaries_info SEI, the ref_display_luminance_info SEI among theparameter sets to the adjusting unit 54.

The decoding unit 53 decodes the encoded data provided from theextracting unit 52 according to the HEVC scheme. At this time, thedecoding unit 53 also refers to the parameter sets provided from theextracting unit 52 as necessary. The decoding unit 53 provides an imageobtained as a result of decoding to the adjusting unit 54.

The adjusting unit 54 acquires color gamut information from thecolour_primaries_info SEI provided from the extracting unit 52 orrecognizes a color gamut based on the index included in the VUI. Theadjusting unit 54 adjusts a color gamut of the image provided from thedecoding unit 53 based on either a color gamut indicated by the acquiredcolor gamut information or the recognized color gamut and a color gamutof the display unit 56.

Further, the adjusting unit 54 acquires the luminance information ofwhite, black, and gray from the ref_display_luminance_info SEI providedfrom the extracting unit 52. The adjusting unit 54 adjusts a luminancedynamic range of the image whose color gamut has been adjusted based onthe acquired luminance information and the luminance information of thedisplay unit 56. The adjusting unit 54 provides the image whoseluminance dynamic range has been adjusted to the display control unit55.

Here, the adjusting of the luminance dynamic range is assumed to beperformed after the adjusting of the color gamut, but the adjusting ofthe luminance dynamic range may be performed before the adjusting of thecolor gamut.

The display control unit 55 causes the image provided from the adjustingunit 54 to be displayed on the display unit 56.

(Description of Processing of Decoding Device)

FIG. 12 is a flowchart for describing an image generation process of thedecoding device 50 of FIG. 11.

In step S51 of FIG. 12, the receiving unit 51 of the decoding device 50receives the encoded stream transmitted from the encoding device 10 ofFIG. 1, and provides the encoded stream to the extracting unit 52.

In step S52, the extracting unit 52 extracts parameter sets and encodeddata from the encoded stream provided from the receiving unit 51. Theextracting unit 52 provides the parameter sets and the encoded data tothe decoding unit 53. Further, the extracting unit 52 provides the VUI,the colour_primaries_info SEI, the ref_display_luminance_info SEI amongthe parameter sets to the adjusting unit 54.

In step S53, the decoding unit 53 decodes the encoded data provided fromthe extracting unit 52 according to the HEVC scheme. At this time, thedecoding unit 53 refers to the parameter sets provided from theextracting unit 52 as necessary. The decoding unit 53 provides an imageobtained as a result of decoding to the adjusting unit 54.

In step S54, the adjusting unit 54 determines whether or not thecolour_primaries_info SEI has been provided from the extracting unit 52.When it is determined in step S54 that the colour_primaries_info SEI hasbeen provided, the process proceeds to step S55.

In step S55, the adjusting unit 54 acquires the color gamut informationfrom the colour_primaries_info SEI, and recognizes a color gamutindicated by the acquired color gamut information. Further, when thecolor gamut information is not included in the colour_primaries_infoSEI, for example, a color gamut is recognized based onlimited_colour_gamut_range_in_percent. Then, the process proceeds tostep S57.

Meanwhile, when it is determined in step S54 that thecolour_primaries_info SEI has not been provided, in step S56, theadjusting unit 54 recognizes a color gamut defined in another standardbased on the index included in the VUI provided from the extracting unit52. Then, the process proceeds to step S57.

In step S57, the adjusting unit 54 adjusts a color gamut of the imageprovided from the decoding unit 53 based on the color gamut of thedisplay unit 56 or the color gamut recognized in step S55 or step S56.

In step S58, the adjusting unit 54 acquires the luminance information ofwhite, black, and gray from the ref_display_luminance_info SEI providedfrom the extracting unit 52.

In step S59, the adjusting unit 54 adjusts a luminance dynamic range ofthe image whose color gamut has been adjusted based on the luminanceinformation of the display unit 56 and the acquired luminanceinformation. The adjusting unit 54 provides the image whose luminancedynamic range has been adjusted to the display control unit 55.

In step S60, the display control unit 55 causes the image provided fromthe adjusting unit 54 to be displayed on the display unit 56, and thenthe process ends.

As described above, the decoding device 50 receives thecolour_primaries_info SEI including the color gamut information, andthus can accurately recognize a color gamut of an encoding target image.As a result, it is possible to optimize a color gamut of a decodedimage. In other words, when a color gamut of an encoding target imagehas a color gamut different from a color gamut defined in anotherstandard, it is possible to a color gamut of a decoded image from beingreduced or enlarged in vain.

Further, the decoding device 50 receives the ref_display_luminance_infoSEI including the luminance information of white, black, and gray andthus accurately recognize the luminance information of the masterdisplay. As a result, it is possible to optimize a luminance dynamicrange of a decoded image.

Furthermore, when a color gamut of an encoding target image is largerthan a color gamut identified by an index included in the VUI, the colorgamut information may not be described in the colour_primaries_info SEI.In this case, the decoding device 50 recognizes a color gamut of anencoding target image and adjusts a color gamut based onlimited_colour_gamut_range_in_percent and a color gamut identified by anindex included in a VUI.

As described above, when the color gamut information is not described,the decoding device 50 can accurately recognize a color gamut of anencoding target image based on limited_colour_gamut_range_in_percent,compared to when a color gamut of an encoding target is defined by anindex of a VUI.

Second Embodiment

(Exemplary Configuration of Encoding Device According to SecondEmbodiment)

FIG. 13 is a block diagram illustrating an exemplary configuration of anencoding device according to a second embodiment of the presentdisclosure.

Among components illustrated in FIG. 13, the same components as thecomponents illustrated in FIG. 1 are denoted by the same referencenumerals. A repeated description will be appropriately omitted.

A configuration of an encoding device 70 of FIG. 13 differs from theconfiguration of FIG. 1 in that a setting unit 72 is provided instead ofthe setting unit 11, and an image adjusting unit 71 is newly provided.

An image is input to the image adjusting unit 71 of the encoding device70 from the outside. The image adjusting unit 71 performs, for example,an operation of editing an image input from the outside while causingthe image to be displayed on the master display (not illustrated)according to a user's authoring work. The image adjusting unit 71provides color gamut information of an edited image and luminanceinformation of white and black of the master display (not illustrated)to the setting unit 72. Further, the image adjusting unit 71 inputs theedited image to the encoding unit 12 as an encoding target image.

The setting unit 72 sets an SPS, a PPS, and a VUI. Further, the settingunit 72 sets the colour_primaries_info SEI including the color gamutinformation and the luminance information provided from the imageadjusting unit 71. The setting unit 72 provides the parameter sets suchas the set SPS, the PPS, the VUI, and the colour_primaries_info SEI tothe encoding unit 12.

(Exemplary Syntax of Colour_Primaries_Info SEI)

FIG. 14 is a diagram illustrating an exemplary syntax of thecolour_primaries_info SEI, and FIGS. 15 to 19 are diagrams fordescribing information of the colour_primaries_info SEI.

As illustrated in FIG. 14, colour_primaries_info_id is described in thecolour_primaries_info SEI. As illustrated in FIG. 15,colour_primaries_info_id is an ID identifying the purpose of the colorgamut information.

Further, as illustrated in FIG. 14, colour_primaries_cancel_flag isdescribed in the colour_primaries_info SEI. As illustrated in FIG. 15,colour_primaries_cancel_flag is a flag indicating whether or notcontinuity of a previous colour_primaries_info SEI is canceled.Colour_primaries_cancel_flag is 1 when the continuity of the previouscolour_primaries_info SEI is canceled, and it is 0 when the continuityof the previous colour_primaries_info SEI is not canceled.

As illustrated in FIG. 14, when colour_primaries_cancel_flag is 0,colour_primaries_persistence_flag is described in thecolour_primaries_info SEI. As illustrated in FIG. 15,colour_primaries_persistence_flag is a flag indicating whether or notthe color gamut information and the luminance information included inthe colour_primaries_info SEI is applied to a plurality of consecutivepictures. colour_primaries_persistence_flag is 1 when the color gamutinformation and the luminance information are applied to a plurality ofconsecutive pictures, and it is 0 when the color gamut information andthe luminance information are applied to only one picture.

Further, as illustrated in FIG. 14,white_level_display_luminance_present_flag is described in thecolour_primaries_info SEI. As illustrated in FIG. 16,white_level_display_luminance_present_flag is a flag indicating whetheror not white_level_display_luminance is described in thecolour_primaries_info SEI. As illustrated in FIG. 19,white_level_display_luminance is the luminance information of white ofthe master display. White_level_display_luminance_present_flag is 1 whenthe luminance information of white of the master display is described inthe colour_primaries_info SEI, andwhite_level_display_luminance_present_flag is 0 when the luminanceinformation of white of the master display is not described in thecolour_primaries_info SEI.

As illustrated in FIGS. 14 and 16, for black, similarly,black_level_display_luminance_present_flag is described in thecolour_primaries_info SEI.

Further, as illustrated in FIG. 14, colour_gamut_coverage_present_flagis described in the colour_primaries_info SET. As illustrated in FIG.16, colour_gamut_coverage_present_flag is a flag indicating whether ornot colour_gamut_coverage is described in the colour_primaries_info SEI.As illustrated in FIG. 19, colour_gamut_coverage is informationindicating a cover ratio of a color gamut of an encoding target image toa color gamut identified by an index described in a VUI.Colour_gamut_coverage_present_flag is 1 when colour_gamut_coverage isdescribed in the colour_primaries_info SEI, andcolour_gamut_coverage_present_flag is 0 when colour_gamut_coverage isnot described in the colour_primaries_info SEI.

As illustrated in FIGS. 14 and 17, colour_primary_Red_x indicating achromaticity of red in the x direction in the CIE color coordinatesystem in the color gamut information and colour_primary_Red_yindicating a chromaticity of red in the y direction are also describedin the colour_primaries_info SEI. As illustrated in FIGS. 14 and 18, forgreen, blue, and white, similarly, colour_primary_Green_x,colour_primary_Green_y, colour_primary_Blue_x, colour_primary_Blue_y,white_point_x, and white_point_y are described in thecolour_primaries_info SEI as the color gamut information.

The color gamut information is described using a 16-bit fixed point. Inother words, the color gamut information is considered to be transmittedfrom the image adjusting unit 71 or the like, for example, throughExtended display identification data (EDID) of High-DefinitionMultimedia Interface (HDMI) (a registered trademark) in which a size oftransmittable information is limited. Further, the applicant hascurrently proposed metadata related to a color gamut described using afixed point as International Electrotechnical Commission (IEC)61966-12-2. Thus, in order not to change the size of the color gamutinformation or in order to cause the proposed metadata to be used as thecolor gamut information, the color gamut information is described usinga fixed point.

Further, the color gamut information according to the first embodimentmay be described using a 16-bit fixed point as well.

As illustrated in FIG. 14, whenwhite_level_display_luminance_present_flag is 1,white_level_display_luminance is described in the colour_primaries_infoSEI. When black_level_display_luminance_present_flag is 1,black_level_display_luminance is described. As illustrated in FIG. 19,black_level_display_luminance is the luminance information of black ofthe master display.

As described above, white_level_display_luminance andblack_level_display_luminance are described in the colour_primaries_infoSEI. In other words, the applicant has currently proposed metadatarelated to luminance including luminance information of white and blackas IEC 61966-12-2. Thus, in order to cause the proposed metadata to beused as white_level_display_luminance and black_level_display_luminance,white_level_display_luminance and black_level_display_luminance aredescribed in the colour_primaries_info SEI.

Further, as illustrated in FIG. 14, whencolour_gamut_coverage_present_flag is 1, colour_gamut_coverage isdescribed in the colour_primaries_info SEI.

(Description of Processing of Encoding Device)

FIG. 20 is a flowchart for describing a stream generation process of theencoding device 70.

In step S80 of FIG. 20, the image adjusting unit 71 performs anoperation of editing an image input from the outside while causing theimage to be displayed on the master display (not illustrated) accordingto the user's authoring work. The image adjusting unit 71 provides colorgamut information of an edited image and luminance information of whiteand black of the master display (not illustrated) to the setting unit72. Further, the image adjusting unit 71 inputs the edited image to theencoding unit 12 as an encoding target image.

A process of steps S81 to S83 is the same as the process of steps S11 toS13 of FIG. 10, and thus a description thereof is omitted.

In step S84, the setting unit 72 sets the colour_primaries_info SEIincluding the color gamut information of the encoding target image andthe luminance information of the master display provided from the imageadjusting unit 71.

A process of steps S85 to S87 is the same as the process of steps S17 toS19 of FIG. 20, and thus a description thereof is omitted.

As described above, the encoding device 70 sets and transmits thecolour_primaries_info SEI including the color gamut information, andthus even when an encoding target image has a color gamut different froma color gamut defined in another standard, it is possible to enable thedecoding side to accurately recognize a color gamut of an encodingtarget image.

Further, the encoding device 70 sets white_level_display_luminance andblack_level_display_luminance to the colour_primaries_info SEI andtransmits the colour_primaries_info SEI, and thus it is possible toenable the decoding side to recognize the luminance information of themaster display.

(Exemplary Configuration of Decoding Device According to SecondEmbodiment)

FIG. 21 is a block diagram illustrating an exemplary configuration of adecoding device that decodes the encoded stream transmitted from theencoding device 70 of FIG. 13 according to the second embodiment of thepresent disclosure.

Among components illustrated in FIG. 21, the same components as thecomponents illustrated in FIG. 11 are denoted by the same referencenumerals. A repeated description will be appropriately omitted.

A configuration of a decoding device 90 of FIG. 21 differs from theconfiguration of FIG. 11 in that an extracting unit 91, an adjustingunit 92, and a display control unit 93 are provided instead of theextracting unit 52, the adjusting unit 54, and the display control unit55.

The extracting unit 91 of the decoding device 90 of FIG. 21 extractsparameter sets and encoded data from the encoded stream provided fromthe receiving unit 51. The extracting unit 91 provides the parametersets and the encoded data to the decoding unit 53. Further, theextracting unit 91 provides the VUI and the colour_primaries_info SEIamong the parameter sets to the adjusting unit 92, and provides thecolour_primaries_info SEI to the display control unit 93.

The adjusting unit 92 acquires color gamut information andcolour_gamut_coverage from the colour_primaries_info SEI provided fromthe extracting unit 91. Further, the adjusting unit 92 recognizes acolor gamut based on an index included in the VUI provided from theextracting unit 91. The adjusting unit 92 adjusts the color gamut of theimage provided from the decoding unit 53 based on either of the colorgamut indicated by the acquired color gamut information and therecognized color gamut, the color gamut based on colour_gamut_coverage,and the color gamut of the display unit 56. The adjusting unit 92provides the image whose color gamut has been adjusted to the displaycontrol unit 93.

The display control unit 93 acquires luminance information of white andblack from the colour_primaries_info SEI provided from the extractingunit 91. The display control unit 93 adjusts a luminance dynamic rangeof the image of the adjusted color gamut provided from the adjustingunit 92 based on the acquired luminance information and the luminanceinformation of the display unit 56. The display control unit 93 providesthe image whose luminance dynamic range has been adjusted to bedisplayed on the display unit 56.

(Description of Processing of Decoding Device)

FIG. 22 is a flowchart for describing an image generation process of thedecoding device 90 of FIG. 21.

In step S101 of FIG. 22, the receiving unit 51 of the decoding device 90receives the encoded stream transmitted from the encoding device 70 ofFIG. 13, and provides the encoded stream to the extracting unit 91.

In step S102, the extracting unit 91 extracts parameter sets and encodeddata from the encoded stream provided from the receiving unit 51. Theextracting unit 91 provides the parameter sets and the encoded data tothe decoding unit 53. Further, the extracting unit 91 provides the VUIand the colour_primaries_info SEI among the parameter sets to theadjusting unit 92, and provides the colour_primaries_info SEI to thedisplay control unit 93.

In step S103, the decoding unit 53 decodes the encoded data providedfrom the extracting unit 91 according to the HEVC scheme. At this time,the decoding unit 53 refers to the parameter sets provided from theextracting unit 91 as necessary. The decoding unit 53 provides an imageobtained as a result of decoding to the adjusting unit 92.

In step S104, the adjusting unit 92 recognizes a color gamut defined inanother standard based on an index included in the VUI provided from theextracting unit 91.

In step S105, the adjusting unit 92 determines whether or not thecolour_primaries_info SEI has been provided from the extracting unit 91.When it is determined in step S105 that the colour_primaries_info SEIhas been provided, the process proceeds to step S106.

In step S106, the adjusting unit 92 acquires the color gamut informationfrom the colour_primaries_info SEI, and recognizes a color gamutindicated by the acquired color gamut information. Further, when thecolor gamut information is not included in the colour_primaries_infoSEI, for example, a color gamut is recognized based oncolour_gamut_coverage and the color gamut recognized in step S104. Then,the process proceeds to step S107.

Meanwhile, when it is determined in step S105 that thecolour_primaries_info SEI has not been provided, the process proceeds tostep S107.

In step S107, the adjusting unit 92 adjusts a color gamut of the imageprovided from the decoding unit 53 based on the color gamut of thedisplay unit 56 or the color gamut recognized in step S104 or step S106.

In step S108, the display control unit 93 acquires luminance informationof white and black from the colour_primaries_info SEI provided from theextracting unit 91. In step S109, the display control unit 93 adjusts aluminance dynamic range of the image of the adjusted color gamutprovided from the adjusting unit 92 based on the luminance informationof the display unit 56 and the acquired luminance information.

In step S110, the display control unit 93 provides the image whoseluminance dynamic range has been adjusted to be displayed on the displayunit 56, and then the process ends.

As described above, the decoding device 90 receives thecolour_primaries_info SEI including the color gamut information, andthus can accurately recognize a color gamut of an encoding target image.As a result, it is possible to optimize a color gamut of a decodedimage. In other words, when a color gamut of an encoding target imagehas a color gamut different from a color gamut defined in anotherstandard, it is possible to a color gamut of a decoded image from beingreduced or enlarged in vain.

For example, when a color gamut of the display unit 56 is larger than acolor gamut of an encoding target image, the decoding device 90 candisplay a decoded image without adjusting a color gamut of the decodedimage. As a result, it is possible to cause an image desired by anauthoring operator to be displayed on the display unit 56.

Further, the decoding device 90 can display a high-quality decoded imageby adjusting a color gamut of a decoded image based on an accuratelyrecognized color gamut.

Furthermore, since white_level_display_luminance andblack_level_display_luminance are also included in thecolour_primaries_info SEI, the decoding device 90 can accuratelyrecognize the luminance information of the master display. As a result,it is possible to optimize a luminance dynamic range of a decoded image.

The above description has been made in connection with the example inwhich the color gamut information and the luminance information arearranged in the SEI, but the color gamut information and the luminanceinformation may be arranged in a system layer.

<Example in which Color Gamut Information and Luminance Information areArranged in MP4 Box>

(Description of MP4 Box in which Color Gamut Information and LuminanceInformation are Arranged)

FIG. 23 is a diagram for describing an MP4 box as a system layer inwhich the color gamut information and the luminance information arearranged.

As illustrated in FIG. 23, when the color gamut information and theluminance information are arranged in the MP4 box, a Colour PrimariesInformation Box (tinf) box storing ColourPrimariesInfo as the colorgamut information and the luminance information is newly defined. Thetinf box is stored in (a stbl box stored in) a trak box or a trackfragment box (traf box).

ColourPrimariesInfo has a configuration similar to thecolour_primaries_info SEI of FIG. 2 and the ref_display_luminance_infoSEI of FIG. 8 or the colour_primaries_info SEI of FIG. 14 except thatpadding value for byte alignment is inserted.

The present disclosure can be applied even to the AVC scheme.

Third Embodiment

(Description of Computer According to Present Disclosure)

The above-described series of processes may be executed by hardware orsoftware. When the series of processes are executed by software, aprogram configuring the software is installed in a computer. Here,examples of the computer includes a computer incorporated into dedicatedhardware and a general purpose personal computer that includes variousprograms installed therein and is capable of executing various kinds offunctions.

FIG. 24 is a block diagram illustrating an exemplary hardwareconfiguration of a computer that executes the above-described series ofprocesses by a program.

In a computer, a central processing unit (CPU) 201, a read only memory(ROM) 202, and a random access memory (RAM) 203 are connected with oneanother via a bus 204.

An input/output (I/O) interface 205 is further connected to the bus 204.An input unit 206, an output unit 207, a storage unit 208, acommunication unit 209, and a drive 210 are connected to the I/Ointerface 205.

The input unit 206 includes a keyboard, a mouse, a microphone, and thelike. The output unit 207 includes a display, a speaker, and the like.The storage unit 208 includes a hard disk, a non-volatile memory, andthe like. The communication unit 209 includes a network interface or thelike. The drive 210 drives a removable medium 211 such as a magneticdisk, an optical disk, a magneto optical disk, or a semiconductormemory.

In the computer having the above configuration, the CPU 201 executes theabove-described series of processes, for example, by loading the programstored in the storage unit 208 onto the RAM 203 through the I/Ointerface 205 and the bus 204 and executing the program.

For example, the program executed by the computer (the CPU 201) may berecorded in the removable medium 211 as a package medium or the like andprovided. Further, the program may be provided through a wired orwireless transmission medium such as a local area network (LAN), theInternet, or digital satellite broadcasting.

In the computer, the removable medium 211 is mounted to the drive 210,and then the program may be installed in the storage unit 208 throughthe I/O interface 205. Further, the program may be received by thecommunication unit 209 via a wired or wireless transmission medium andthen installed in the storage unit 208. In addition, the program may beinstalled in the ROM 202 or the storage unit 208 in advance.

Further, the program may be a program in which the processes arechronologically performed in the order described in this disclosure ormay be a program in which the processes are performed in parallel or atnecessary timings such as called timings.

Fourth Embodiment

(Application to Multi-View Image Coding and Multi-View Image Decoding)

The above-described series of processes can be applied to multi-viewimage coding and multi-view image decoding. FIG. 25 illustrates anexemplary multi-view image coding scheme.

As illustrated in FIG. 25, a multi-view image includes images of aplurality of views. The plurality of views of the multi-view imageinclude a base view in which encoding and decoding are performed usingonly an image of its own view without using images of other views and anon-base view in which encoding and decoding are performed using imagesof other views. As the non-base view, an image of a base view may beused, and an image of another non-base view may be used.

When the multi-view image of FIG. 25 is encoded and decoded, an image ofeach view is encoded and decoded, but the technique according to thefirst embodiment may be applied to encoding and decoding of respectiveviews. Accordingly, a color gamut of an encoding target image can beaccurately recognized at a decoding side.

Furthermore, the flags or the parameters used in the technique accordingto the first embodiment may be shared in encoding and decoding ofrespective views. More specifically, for example, the syntax elements ofthe colour_primaries_info SEI or the ref_display_luminance_info SEI maybe shared in encoding and decoding of respective views. Of course, anyother necessary information may be shared in encoding and decoding ofrespective views.

Accordingly, it is possible to prevent transmission of redundantinformation and reduce an amount (bit rate) of information to betransmitted (that is, it is possible to prevent coding efficiency fromdegrading.

(Multi-View Image Encoding Device)

FIG. 26 is a diagram illustrating a multi-view image encoding devicethat performs the above-described multi-view image coding. A multi-viewimage encoding device 600 includes an encoding unit 601, an encodingunit 602, and a multiplexing unit 603 as illustrated in FIG. 26.

The encoding unit 601 encodes a base view image, and generates a baseview image encoded stream. The encoding unit 602 encodes a non-base viewimage, and generates a non-base view image encoded stream. Themultiplexing unit 603 performs multiplexing of the base view imageencoded stream generated by the encoding unit 601 and the non-base viewimage encoded stream generated by the encoding unit 602, and generates amulti-view image encoded stream.

The encoding device 10 (FIG. 1) can be applied as the encoding unit 601and the encoding unit 602 of the multi-view image encoding device 600.In other words, it is possible to enable a decoding side to accuratelyrecognize a color gamut of an encoding target image when encoding ofeach view is performed. Further, the encoding unit 601 and the encodingunit 602 can perform encoding using the same flags or parameters (forexample, syntax elements related to inter-image processing) (that is,can share the flags or the parameters), and thus it is possible toprevent the coding efficiency from degrading.

(Multi-View Image Decoding Device)

FIG. 27 is a diagram illustrating a multi-view image decoding devicethat performs the above-described multi-view image decoding. Amulti-view image decoding device 610 includes a demultiplexing unit 611,a decoding unit 612, and a decoding unit 613 as illustrated in FIG. 27.

The demultiplexing unit 611 performs demultiplexing of the multi-viewimage encoded stream obtained by multiplexing the base view imageencoded stream and the non-base view image encoded stream, and extractsthe base view image encoded stream and the non-base view image encodedstream. The decoding unit 612 decodes the base view image encoded streamextracted by the demultiplexing unit 611, and obtains the base viewimage. The decoding unit 613 decodes the non-base view image encodedstream extracted by the demultiplexing unit 611, and obtains thenon-base view image.

The decoding device 50 (FIG. 11) can be applied as the decoding unit 612and the decoding unit 613 of the multi-view image decoding device 610.In other words, a color gamut of an encoding target image can beaccurately recognized when decoding of each view is performed. Further,the decoding unit 612 and the decoding unit 613 can perform decodingusing the same flags or parameters (for example, syntax elements relatedto inter-image processing) (that is, can share the flags or theparameters), and thus it is possible to prevent the coding efficiencyfrom degrading.

Fifth Embodiment

(Application to Scalable Image Coding and Scalable Image Decoding)

The above-described series of processes can be applied to scalable imagecoding and scalable image decoding (scalable coding and scalabledecoding). FIG. 28 illustrates an exemplary scalable image codingscheme.

The scalable image coding (scalable coding) is a scheme in which animage is divided into a plurality of layers (hierarchized) so that imagedata has a scalable function for a certain parameter, and encoding isperformed on each layer. The scalable image decoding (scalable decoding)is decoding corresponding to the scalable image coding.

As illustrated in FIG. 28, for hierarchization of an image, an image isdivided into a plurality of images (layers) based on a certain parameterhaving a scalable function. In other words, a hierarchized image (ascalable image) includes images of a plurality of layers that differ ina value of the certain parameter from one another. The plurality oflayers of the scalable image include a base layer in which encoding anddecoding are performed using only an image of its own layer withoutusing images of other layers and non-base layers (which are alsoreferred to as “enhancement layers”) in which encoding and decoding areperformed using images of other layers. As the non-base layer, an imageof the base layer may be used, and an image of any other non-base layermay be used.

Generally, the non-base layer is configured with data (differentialdata) of a differential image between its own image and an image ofanother layer so that the redundancy is reduced. For example, when oneimage is hierarchized into two layers, that is, a base layer and anon-base layer (which is also referred to as an enhancement layer), animage of a quality lower than an original image is obtained when onlydata of the base layer is used, and an original image (that is, a highquality image) is obtained when both data of the base layer and data ofthe non-base layer are combined.

As an image is hierarchized as described above, images of variousqualities can be obtained depending on the situation. For example, for aterminal having a low processing capability such as a mobile terminal,image compression information of only the base layer is transmitted, anda moving image of low spatial and temporal resolutions or a low qualityis reproduced, and for a terminal having a high processing capabilitysuch as a television or a personal computer, image compressioninformation of the enhancement layer as well as the base layer istransmitted, and a moving image of high spatial and temporal resolutionsor a high quality is reproduced. In other words, without performing thetranscoding process, image compression information according to acapability of a terminal or a network can be transmitted from a server.

When the scalable image illustrated in FIG. 28 is encoded and decoded,images of respective layers are encoded and decoded, but the techniqueaccording to the first embodiment may be applied to encoding anddecoding of the respective layers. Accordingly, a color gamut of anencoding target image can be accurately recognized at the decoding side.

Furthermore, the flags or the parameters used in the technique accordingto the first embodiment may be shared in encoding and decoding ofrespective layers. More specifically, for example, the syntax elementsof the colour_primaries_info SEI or the ref_display_luminance_info SEImay be shared in encoding and decoding of respective layers. Of course,any other necessary information may be shared in encoding and decodingof respective views.

Accordingly, it is possible to prevent transmission of redundantinformation and reduce an amount (bit rate) of information to betransmitted (that is, it is possible to prevent coding efficiency fromdegrading.

(Scalable Parameter)

In the scalable image coding and the scalable image decoding (thescalable coding and the scalable decoding), any parameter has a scalablefunction. For example, a spatial resolution may be used as the parameter(spatial scalability) as illustrated in FIG. 29. In the case of thespatial scalability, respective layers have different image resolutions.In other words, in this case, each picture is hierarchized into twolayers, that is, a base layer of a resolution spatially lower than thatof an original image and an enhancement layer that is combined with thebase layer to obtain an original spatial resolution as illustrated inFIG. 29. Of course, the number of layers is an example, and each picturecan be hierarchized into an arbitrary number of layers.

As another parameter having such scalability, for example, a temporalresolution may be applied (temporal scalability) as illustrated in FIG.30. In the case of the temporal scalability, respective layers havingdifferent frame rates. In other words, in this case, each picture ishierarchized into two layers, that is, a base layer of a frame ratelower than that of an original moving image and an enhancement layerthat is combined with the base layer to obtain an original frame rate asillustrated in FIG. 30. Of course, the number of layers is an example,and each picture can be hierarchized into an arbitrary number of layers.

As another parameter having such scalability, for example, asignal-to-noise ratio (SNR) may be applied (SNR scalability). In thecase of the SNR scalability, respective layers having different SNRs. Inother words, in this case, each picture is hierarchized into two layers,that is, a base layer of a SNR lower than that of an original image andan enhancement layer that is combined with the base layer to obtain anoriginal SNR as illustrated in FIG. 31. Of course, the number of layersis an example, and each picture can be hierarchized into an arbitrarynumber of layers.

A parameter other than the above-described examples may be applied as aparameter having scalability. For example, a bit depth may be used as aparameter having scalability (bit-depth scalability). In the case of thebit-depth scalability, respective layers have different bit depths. Inthis case, for example, the base layer (base layer) includes a 8-bitimage, and a 10-bit image can be obtained by adding the enhancementlayer to the base layer.

As another parameter having scalability, for example, a chroma formatmay be used (chroma scalability). In the case of the chroma scalability,respective layers have different chroma formats. In this case, forexample, the base layer (base layer) includes a component image of a4:2:0 format, and a component image of a 4:2:2 format can be obtained byadding the enhancement layer to the base layer.

(Scalable Image Encoding Device)

FIG. 32 is a diagram illustrating a scalable image encoding device thatperforms the above-described scalable image coding. A scalable imageencoding device 620 includes an encoding unit 621, an encoding unit 622,and a multiplexing unit 623 as illustrated in FIG. 32.

The encoding unit 621 encodes a base layer image, and generates a baselayer image encoded stream. The encoding unit 622 encodes a non-baselayer image, and generates a non-base layer image encoded stream. Themultiplexing unit 623 performs multiplexing the base layer image encodedstream generated by the encoding unit 621 and the non-base layer imageencoded stream generated by the encoding unit 622, and generates ascalable image encoded stream.

The encoding device 10 (FIG. 1) can be applied as the encoding unit 621and the encoding unit 622 of the scalable image encoding device 620. Inother words, it is possible to enable the decoding side to accuratelyrecognize a color gamut of an encoding target image when encoding ofeach layer is performed. Further, the encoding unit 621 and the encodingunit 622 can perform, for example, control of an intra-prediction filterprocess using the same flags or parameters (for example, syntax elementsrelated to inter-image processing) (that is, can share the flags or theparameters), and thus it is possible to prevent the coding efficiencyfrom degrading.

(Scalable Image Decoding Device)

FIG. 33 is a diagram illustrating a scalable image decoding device thatperforms the above-described scalable image decoding. A scalable imagedecoding device 630 includes a demultiplexing unit 631, a decoding unit632, and a decoding unit 633 as illustrated in FIG. 33.

The demultiplexing unit 631 performs demultiplexing of the scalableimage encoded stream obtained by multiplexing the base layer imageencoded stream and the non-base layer image encoded stream, and extractsthe base layer image encoded stream and the non-base layer image encodedstream. The decoding unit 632 decodes the base layer image encodedstream extracted by the demultiplexing unit 631, and obtains the baselayer image. The decoding unit 633 decodes the non-base layer imageencoded stream extracted by the demultiplexing unit 631, and obtains thenon-base layer image.

The decoding device 50 (FIG. 11) can be applied as the decoding unit 632and the decoding unit 633 of the scalable image decoding device 630. Inother words, a color gamut of an encoding target image can be accuratelyrecognized when decoding of each layer is performed. Further, thedecoding unit 612 and the decoding unit 613 can perform decoding usingthe same flags or parameters (for example, syntax elements related tointer-image processing) (that is, can share the flags or theparameters), and thus it is possible to prevent the coding efficiencyfrom degrading.

Sixth Embodiment

(Exemplary Configuration of Television Device)

FIG. 34 illustrates a schematic configuration of a television device towhich the present technology is applied. A television device 900includes an antenna 901, a tuner 902, a demultiplexer 903, a decoder904, a video signal processing unit 905, a display unit 906, an audiosignal processing unit 907, a speaker 908, and an external I/F unit 909.The television device 900 further includes a control unit 910, a userI/F unit 911, and the like.

The tuner 902 tunes to a desired channel from a broadcast signalreceived by the antenna 901, performs demodulation, and outputs anobtained encoded bitstream to the demultiplexer 903.

The demultiplexer 903 extracts video or audio packets of a program of aviewing target from the encoded bitstream, and outputs data of theextracted packets to the decoder 904. The demultiplexer 903 providesdata of packets of data such as an electronic program guide (EPG) to thecontrol unit 910. Further, when scrambling has been performed,descrambling is performed by the demultiplexer or the like.

The decoder 904 performs a decoding process of decoding the packets, andoutputs video data and audio data generated by the decoding process tothe video signal processing unit 905 and the audio signal processingunit 907.

The video signal processing unit 905 performs a noise canceling processor video processing according to a user setting on the video data. Thevideo signal processing unit 905 generates video data of a program to bedisplayed on the display unit 906, image data according to processingbased on an application provided via a network, or the like. The videosignal processing unit 905 generates video data for displaying, forexample, a menu screen used to select an item, and causes the video datato be superimposed on video data of a program. The video signalprocessing unit 905 generates a drive signal based on the video datagenerated as described above, and drives the display unit 906.

The display unit 906 drives a display device (for example, a liquidcrystal display device or the like) based on the drive signal providedfrom the video signal processing unit 905, and causes a program video orthe like to be displayed.

The audio signal processing unit 907 performs a certain process such asa noise canceling process on the audio data, performs a digital toanalog (D/A) conversion process and an amplification process on theprocessed audio data, and provides resultant data to the speaker 908 tooutput a sound.

The external I/F unit 909 is an interface for a connection with anexternal device or a network, and performs transmission and reception ofdata such as video data or audio data.

The user I/F unit 911 is connected with the control unit 910. The userI/F unit 911 includes an operation switch, a remote control signalreceiving unit, and the like, and provides an operation signal accordingto the user's operation to the control unit 910.

The control unit 910 includes a central processing unit (CPU), a memory,and the like. The memory stores a program executed by the CPU, variouskinds of data necessary when the CPU performs processing, EPG data, dataacquired via a network, and the like. The program stored in the memoryis read and executed by the CPU at a certain timing such as a timing atwhich the television device 900 is activated. The CPU executes theprogram, and controls the respective units such that the televisiondevice 900 is operated according to the user's operation.

The television device 900 is provided with a bus 912 that connects thetuner 902, the demultiplexer 903, the video signal processing unit 905,the audio signal processing unit 907, the external I/F unit 909, and thelike with the control unit 910.

In the television device having the above configuration, the decoder 904is provided with the function of the decoding device (decoding method)according to the present application. Thus, it is possible to accuratelyrecognize a color gamut of an encoding target image.

Seventh Embodiment

(Exemplary Configuration of Mobile Telephone)

FIG. 35 illustrates a schematic configuration of a mobile telephone towhich the present technology is applied. A mobile telephone 920 includesa communication unit 922, a voice codec 923, a camera unit 926, an imageprocessing unit 927, a multiplexing/demultiplexing unit 928, arecording/reproducing unit 929, a display unit 930, and a control unit931. These units are connected with one another via a bus 933.

Further, an antenna 921 is connected to the communication unit 922, anda speaker 924 and a microphone 925 are connected to the voice codec 923.Further, an operating unit 932 is connected to the control unit 931.

The mobile telephone 920 performs various kinds of operations such astransmission and reception of a voice signal, transmission and receptionof an electronic mail or image data, image capturing, or data recordingin various modes such as a voice call mode and a data communicationmode.

In the voice call mode, a voice signal generated by the microphone 925is converted to voice data through the voice codec 923, compressed, andthen provided to the communication unit 922. The communication unit 922performs, for example, a modulation process and a frequency transformprocess of the voice data, and generates a transmission signal. Further,the communication unit 922 provides the transmission signal to theantenna 921 so that the transmission signal is transmitted to a basestation (not illustrated). Further, the communication unit 922 performsan amplification process, a frequency transform process, and ademodulation process of a reception signal received through the antenna921, and provides the obtained voice data to the voice codec 923. Thevoice codec 923 decompresses the voice data, converts the compresseddata to an analog voice signal, and outputs the analog voice signal tothe speaker 924.

In the data communication mode, when mail transmission is performed, thecontrol unit 931 receives text data input by operating the operatingunit 932, and causes the input text to be displayed on the display unit930. Further, the control unit 931 generates mail data, for example,based on a user instruction input through the operating unit 932, andprovides the mail data to the communication unit 922. The communicationunit 922 performs, for example, a modulation process and a frequencytransform process of the mail data, and transmits an obtainedtransmission signal through the antenna 921. Further, the communicationunit 922 performs, for example, an amplification process, a frequencytransform process, and a demodulation process of a reception signalreceived through the antenna 921, and restores the mail data. The maildata is provided to the display unit 930 so that mail content isdisplayed.

The mobile telephone 920 can store the received mail data in a storagemedium through the recording/reproducing unit 929. The storage medium isan arbitrary rewritable storage medium. Examples of the storage mediuminclude a semiconductor memory such as a RAM or an internal flashmemory, a hard disk, a magnetic disk, a magneto optical disk, an opticaldisk, and a removable medium such as a universal serial bus (USB) memoryor a memory card.

In the data communication mode, when image data is transmitted, imagedata generated through the camera unit 926 is provided to the imageprocessing unit 927. The image processing unit 927 performs an encodingprocess of encoding the image data, and generates encoded data.

The multiplexing/demultiplexing unit 928 multiplexes the encoded datagenerated through the image processing unit 927 and the voice dataprovided from the voice codec 923 according to a certain scheme, andprovides resultant data to the communication unit 922. The communicationunit 922 performs, for example, a modulation process and a frequencytransform process of the multiplexed data, and transmits an obtainedtransmission signal through the antenna 921. Further, the communicationunit 922 performs, for example, an amplification process, a frequencytransform process, and a demodulation process of a reception signalreceived through the antenna 921, and restores multiplexed data. Themultiplexed data is provided to the multiplexing/demultiplexing unit928. The multiplexing/demultiplexing unit 928 demultiplexes themultiplexed data, and provides the encoded data and the voice data tothe image processing unit 927 and the voice codec 923. The imageprocessing unit 927 performs a decoding process of decoding the encodeddata, and generates image data. The image data is provided to thedisplay unit 930 so that a received image is displayed. The voice codec923 converts the voice data into an analog voice signal, provides theanalog voice signal to the speaker 924, and outputs a received voice.

In the mobile telephone having the above configuration, the imageprocessing unit 927 is provided with the function of the encoding deviceand the decoding device (the encoding method and the decoding method)according to the present application. Thus, it is possible to enable thedecoding side to accurately recognize a color gamut of an encodingtarget image. Further, it is possible to accurately recognize a colorgamut of an encoding target image.

Eighth Embodiment

(Exemplary Configuration of Recording/Reproducing Device)

FIG. 36 illustrates a schematic configuration of a recording/reproducingdevice to which the present technology is applied. Arecording/reproducing device 940 records, for example, audio data andvideo data of a received broadcast program in a recording medium, andprovides the recorded data to the user at a timing according to theuser's instruction. Further, the recording/reproducing device 940 canacquire, for example, audio data or video data from another device andcause the acquired data to be recorded in a recording medium.Furthermore, the recording/reproducing device 940 decodes and outputsthe audio data or the video data recorded in the recording medium sothat an image display or a sound output can be performed in a monitordevice.

The recording/reproducing device 940 includes a tuner 941, an externalI/F unit 942, an encoder 943, a hard disk drive (HDD) unit 944, a diskdrive 945, a selector 946, a decoder 947, an on-screen display (OSD)unit 948, a control unit 949, and a user I/F unit 950.

The tuner 941 tunes to a desired channel from a broadcast signalreceived through an antenna (not illustrated). The tuner 941 demodulatesa reception signal of the desired channel, and outputs an obtainedencoded bitstream to the selector 946.

The external I/F unit 942 is configured with at least one of an IEEE1394interface, a network interface, a USB interface, a flash memoryinterface, and the like. The external I/F unit 942 is an interface for aconnection with an external device, a network, a memory card, and thelike, and receives data such as video data to audio data to be recorded.

The encoder 943 ends non-encoded video data or audio data provided fromthe external I/F unit 942 according to a certain scheme, and outputs anencoded bitstream to the selector 946.

The HDD unit 944 records content data such as a video or a sound,various kinds of programs, and other data in an internal hard disk, andreads recorded data from the hard disk at the time of reproduction orthe like.

The disk drive 945 records a signal in a mounted optical disk, andreproduces a signal from the optical disk. Examples of the optical diskinclude a DVD disk (DVD-Video, DVD-RAM, DVD-R, DVD-RW, DVD+R, DVD+RW,and the like) and a Blu-ray (a registered trademark) disk.

When a video or a sound is recorded, the selector 946 selects either ofan encoded bitstream provided the tuner 941 and an encoded bitstreamprovided from the encoder 943, and provides the selected encodedbitstream to either of the HDD unit 944 or the disk drive 945. Further,when a video or a sound is reproduced, the selector 946 provides theencoded bitstream output from the HDD unit 944 or the disk drive 945 tothe decoder 947.

The decoder 947 performs the decoding process of decoding the encodedbitstream. The decoder 947 provides video data generated by performingthe decoding process to the OSD unit 948. Further, the decoder 947outputs audio data generated by performing the decoding process.

The OSD unit 948 generates video data used to display, for example, amenu screen used to, for example, select an item, and outputs the videodata to be superimposed on the video data output from the decoder 947.

The user I/F unit 950 is connected to the control unit 949. The user I/Funit 950 includes an operation switch, a remote control signal receivingunit, and the like, and provides an operation signal according to theuser's operation to the control unit 949.

The control unit 949 is configured with a CPU, a memory, and the like.The memory stores a program executed by the CPU and various kinds ofdata necessary when the CPU performs processing. The program stored inthe memory is read and executed by the CPU at a certain timing such as atiming at which the recording/reproducing device 940 is activated. TheCPU executes the program, and controls the respective units such thatthe recording/reproducing device 940 is operated according to the user'soperation.

In the recording/reproducing device having the above configuration, thedecoder 947 is provided with the function of the decoding device(decoding method) according to the present application. Thus, it ispossible to accurately recognize a color gamut of an encoding targetimage.

Ninth Embodiment

(Exemplary Configuration of Imaging Device)

FIG. 37 illustrates a schematic configuration of an imaging device towhich the present technology is applied. An imaging device 960photographs a subject, and causes an image of the subject to bedisplayed on a display unit or records image data in a recording medium.

The imaging device 960 includes an optical block 961, an imaging unit962, a camera signal processing unit 963, an image data processing unit964, a display unit 965, an external I/F unit 966, a memory unit 967, amedium drive 968, an OSD unit 969, and a control unit 970. Further, auser I/F unit 971 is connected to the control unit 970. Furthermore, theimage data processing unit 964, the external I/F unit 966, the memoryunit 967, the medium drive 968, the OSD unit 969, the control unit 970,and the like are connected with one another via a bus 972.

The optical block 961 is configured with a focus lens, a diaphragmmechanism, and the like. The optical block 961 forms an optical image ofa subject on an imaging plane of the imaging unit 962. The imaging unit962 is configured with a CCD image sensor or a CMOS image sensor, andgenerates an electrical signal according to an optical image obtained byphotoelectric conversion, and provides the electrical signal to thecamera signal processing unit 963.

The camera signal processing unit 963 performs various kinds of camerasignal processes such as knee correction, gamma correction, and colorcorrection on the electrical signal provided from the imaging unit 962.The camera signal processing unit 963 provides the image data that hasbeen subjected to the camera signal processes to the image dataprocessing unit 964.

The image data processing unit 964 performs the encoding process ofencoding the image data provided from the camera signal processing unit963. The image data processing unit 964 provides encoded data generatedby performing the encoding process to the external I/F unit 966 or themedium drive 968. Further, the image data processing unit 964 performsthe decoding process of decoding encoded data provided from the externalI/F unit 966 or the medium drive 968. The image data processing unit 964provides image data generated by performing the decoding process to thedisplay unit 965. Further, the image data processing unit 964 performs aprocess of providing the image data provided from the camera signalprocessing unit 963 to the display unit 965, or provides display dataacquired from the OSD unit 969 to the display unit 965 to besuperimposed on image data.

The OSD unit 969 generates a menu screen including a symbol, a text, ora diagram or display data such as an icon, and outputs the generatedmenu screen or the display data to the image data processing unit 964.

The external I/F unit 966 is configured with, for example, an USB I/Oterminal or the like, and connected with a printer when an image isprinted. Further, a drive is connected to the external I/F unit 966 asnecessary, a removable medium such as a magnetic disk or an optical diskis appropriately mounted, and a computer program read from the removablemedium is installed as necessary. Furthermore, the external I/F unit 966is connected to a certain network such as an LAN or the Internet, andincludes a network interface. The control unit 970 can read encoded datafrom the medium drive 968, for example, according to an instructiongiven through the user I/F unit 971 and provide the read encoded data toanother device connected via a network through the external I/F unit966. Further, the control unit 970 can acquire encoded data or imagedata provided from another device via a network through the external I/Funit 966 and provide the acquire encoded data or the image data to theimage data processing unit 964.

As a recording medium driven by the medium drive 968, for example, anarbitrary readable/writable removable medium such as a magnetic disk, amagneto optical disk, an optical disk, or a semiconductor memory isused. Further, the recording medium may be a tape device, a disk, or amemory card regardless of a type of a removable medium. Of course, therecording medium may be a non-contact integrated circuit (IC) card orthe like.

Further, the medium drive 968 may be integrated with the recordingmedium to configure a non-portable storage medium such as an internalHDD or a solid state drive (SSD).

The control unit 970 is configured with a CPU. The memory unit 967stores a program executed by the control unit 970, various kinds of datanecessary when the control unit 970 performs processing, and the like.The program stored in the memory unit 967 is read and executed by thecontrol unit 970 at a certain timing such as a timing at which theimaging device 960 is activated. The control unit 970 executes theprogram, and controls the respective units such that the imaging device960 is operated according to the user's operation.

In the imaging device having the above configuration, the image dataprocessing unit 964 is provided with the function of the decoding device(decoding method) according to the present application. Thus, it ispossible to enable the decoding side to accurately recognize a colorgamut of an encoding target image. Further, it is possible to accuratelyrecognize a color gamut of an encoding target image.

<Applications of Scalable Coding>

(First System)

Next, concrete application examples of scalable encoded data generatedby scalable coding will be described. The scalable coding is used forselection of data to be transmitted, for example, as illustrated in FIG.38.

In a data transmission system 1000 illustrated in FIG. 38, a deliveryserver 1002 reads scalable encoded data stored in a scalable encodeddata storage unit 1001, and delivers the scalable encoded data toterminal devices such as a personal computer 1004, an AV device 1005, atablet device 1006, and a mobile telephone 1007 via a network 1003.

At this time, the delivery server 1002 selects an appropriatehigh-quality encoded data according to the capabilities of the terminaldevices or a communication environment, and transmits the selectedhigh-quality encoded data. Although the delivery server 1002 transmitsunnecessarily high-quality data, the terminal devices do not necessarilyobtains a high-quality image, and a delay or an overflow may occur.Further, a communication band may be unnecessarily occupied, and a loadof a terminal device may be unnecessarily increased. On the other hand,although the delivery server 1002 transmits unnecessarily low-qualitydata, the terminal devices are unlikely to obtain an image of asufficient quality. Thus, the delivery server 1002 reads scalableencoded data stored in the scalable encoded data storage unit 1001 asencoded data of a quality appropriate for the capability of the terminaldevice or a communication environment, and then transmits the read data.

For example, the scalable encoded data storage unit 1001 is assumed tostores scalable encoded data (BL+EL) 1011 that is encoded by thescalable coding. The scalable encoded data (BL+EL) 1011 is encoded dataincluding both of a base layer and an enhancement layer, and both animage of the base layer and an image of the enhancement layer can beobtained by decoding the scalable encoded data (BL+EL) 1011.

The delivery server 1002 selects an appropriate layer according to thecapability of a terminal device to which data is transmitted or acommunication environment, and reads data of the selected layer. Forexample, for the personal computer 1004 or the tablet device 1006 havinga high processing capability, the delivery server 1002 reads thehigh-quality scalable encoded data (BL+EL) 1011 from the scalableencoded data storage unit 1001, and transmits the scalable encoded data(BL+EL) 1011 without change. On the other hand, for example, for the AVdevice 1005 or the mobile telephone 1007 having a low processingcapability, the delivery server 1002 extracts data of the base layerfrom the scalable encoded data (BL+EL) 1011, and transmits a scalableencoded data (BL) 1012 that is the same content as the scalable encodeddata (BL+EL) 1011 but lower in quality than the scalable encoded data(BL+EL) 1011.

As described above, an amount of data can be easily adjusted usingscalable encoded data, and thus it is possible to prevent the occurrenceof a delay or an overflow and prevent a load of a terminal device or acommunication medium from being unnecessarily increased. Further, thescalable encoded data (BL+EL) 1011 is reduced in redundancy betweenlayers, and thus it is possible to reduce an amount of data to besmaller than when individual data is used as encoded data of each layer.Thus, it is possible to more efficiently use a memory area of thescalable encoded data storage unit 1001.

Further, various devices such as the personal computer 1004 to themobile telephone 1007 can be applied as the terminal device, and thusthe hardware performance of the terminal devices differ according toeach device. Further, since various applications can be executed by theterminal devices, software has various capabilities. Furthermore, allcommunication line networks including either or both of a wired networkand a wireless network such as the Internet or a local area network(LAN), can be applied as the network 1003 serving as a communicationmedium, and thus various data transmission capabilities are provided. Inaddition, a change may be made by another communication or the like.

In this regard, the delivery server 1002 may be configured to performcommunication with a terminal device serving as a transmissiondestination of data before starting data transmission and obtaininformation related to a capability of a terminal device such ashardware performance of a terminal device or a performance of anapplication (software) executed by a terminal device and informationrelated to a communication environment such as an available bandwidth ofthe network 1003. Then, the delivery server 1002 may select anappropriate layer based on the obtained information.

Further, the extracting of the layer may be performed in a terminaldevice. For example, the personal computer 1004 may decode thetransmitted scalable encoded data (BL+EL) 1011 and display the image ofthe base layer or the image of the enhancement layer. Further, forexample, the personal computer 1004 may extract the scalable encodeddata (BL) 1012 of the base layer from the transmitted scalable encodeddata (BL+EL) 1011, store the scalable encoded data (BL) 1012 of the baselayer, transfer the scalable encoded data (BL) 1012 of the base layer toanother device, decode the scalable encoded data (BL) 1012 of the baselayer, and display the image of the base layer.

Of course, the number of the scalable encoded data storage units 1001,the number of the delivery servers 1002, the number of the networks1003, and the number of terminal devices are arbitrary. The abovedescription has been made in connection with the example in which thedelivery server 1002 transmits data to the terminal devices, but theapplication example is not limited to this example. The datatransmission system 1000 can be applied to any system in which whenencoded data generated by the scalable coding is transmitted to aterminal device, an appropriate layer is selected according to acapability of a terminal devices or a communication environment, and theencoded data is transmitted.

(Second System)

The scalable coding is used for transmission using a plurality ofcommunication media, for example, as illustrated in FIG. 39.

In a data transmission system 1100 illustrated in FIG. 39, abroadcasting station 1101 transmits scalable encoded data (BL) 1121 of abase layer through terrestrial broadcasting 1111. Further, thebroadcasting station 1101 transmits scalable encoded data (EL) 1122 ofan enhancement layer (for example, packetizes the scalable encoded data(EL) 1122 and then transmits resultant packets) via an arbitrary network1112 configured with a communication network including either or both ofa wired network and a wireless network.

A terminal device 1102 has a reception function of receiving theterrestrial broadcasting 1111 broadcast by the broadcasting station1101, and receives the scalable encoded data (BL) 1121 of the base layertransmitted through the terrestrial broadcasting 1111. The terminaldevice 1102 further has a communication function of performingcommunication via the network 1112, and receives the scalable encodeddata (EL) 1122 of the enhancement layer transmitted via the network1112.

The terminal device 1102 decodes the scalable encoded data (BL) 1121 ofthe base layer acquired through the terrestrial broadcasting 1111, forexample, according to the user's instruction or the like, obtains theimage of the base layer, stores the obtained image, and transmits theobtained image to another device.

Further, the terminal device 1102 combines the scalable encoded data(BL) 1121 of the base layer acquired through the terrestrialbroadcasting 1111 with the scalable encoded data (EL) 1122 of theenhancement layer acquired through the network 1112, for example,according to the user's instruction or the like, obtains the scalableencoded data (BL+EL), decodes the scalable encoded data (BL+EL) toobtain the image of the enhancement layer, stores the obtained image,and transmits the obtained image to another device.

As described above, it is possible to transmit scalable encoded data ofrespective layers, for example, through different communication media.Thus, it is possible to distribute a load, and it is possible to preventthe occurrence of a delay or an overflow.

Further, it is possible to select a communication medium used fortransmission for each layer according to the situation, transmission.For example, the scalable encoded data (BL) 1121 of the base layerhaving a relative large amount of data may be transmitted through acommunication medium having a large bandwidth, and the scalable encodeddata (EL) 1122 of the enhancement layer having a relative small amountof data may be transmitted through a communication medium having a smallbandwidth. Further, for example, a communication medium for transmittingthe scalable encoded data (EL) 1122 of the enhancement layer may beswitched between the network 1112 and the terrestrial broadcasting 1111according to an available bandwidth of the network 1112. Of course, thesame applies to data of an arbitrary layer.

As control is performed as described above, it is possible to furthersuppress an increase in a load in data transmission.

Of course, the number of layers is an arbitrary, and the number ofcommunication media used for transmission is also arbitrary. Further,the number of the terminal devices 1102 serving as a data deliverydestination is also arbitrary. The above description has been describedin connection with the example of broadcasting from the broadcastingstation 1101, and the application example is not limited to thisexample. The data transmission system 1100 can be applied to any systemin which encoded data generated by the scalable coding is divided intotwo or more in units of layers and transmitted through a plurality oflines.

(Third System)

The scalable coding is used for storage of encoded data, for example, asillustrated in FIG. 40.

In an imaging system 1200 illustrated in FIG. 40, an imaging device 1201photographs a subject 1211, performs the scalable coding on obtainedimage data, and provides scalable encoded data (BL+EL) 1221 to ascalable encoded data storage device 1202.

The scalable encoded data storage device 1202 stores the scalableencoded data (BL+EL) 1221 provided from the imaging device 1201 in aquality according to the situation. For example, during a normal time,the scalable encoded data storage device 1202 extracts data of the baselayer from the scalable encoded data (BL+EL) 1221, and stores theextracted data as scalable encoded data (BL) 1222 of the base layerhaving a small amount of data in a low quality. On the other hand, forexample, during an observation time, the scalable encoded data storagedevice 1202 stores the scalable encoded data (BL+EL) 1221 having a largeamount of data in a high quality without change.

Accordingly, the scalable encoded data storage device 1202 can store animage in a high quality only when necessary, and thus it is possible tosuppress an increase in an amount of data and improve use efficiency ofa memory area while suppressing a reduction in a value of an imagecaused by quality deterioration.

For example, the imaging device 1201 is a monitoring camera. Whenmonitoring target (for example, intruder) is not shown on a photographedimage (during a normal time), content of the photographed image islikely to be inconsequential, and thus a reduction in an amount of datais prioritized, and image data (scalable encoded data) is stored in alow quality. On the other hand, when a monitoring target is shown on aphotographed image as the subject 1211 (during an observation time),content of the photographed image is likely to be consequential, andthus an image quality is prioritized, and image data (scalable encodeddata) is stored in a high quality.

It may be determined whether it is the normal time or the observationtime, for example, by analyzing an image through the scalable encodeddata storage device 1202. Further, the imaging device 1201 may performthe determination and transmits the determination result to the scalableencoded data storage device 1202.

Further, a determination criterion as to whether it is the normal timeor the observation time is arbitrary, and content of an image serving asthe determination criterion is arbitrary. Of course, a condition otherthan content of an image may be a determination criterion. For example,switching may be performed according to the magnitude or a waveform of arecorded sound, switching may be performed at certain time intervals, orswitching may be performed according an external instruction such as theuser's instruction.

The above description has been described in connection with the examplein which switching is performed between two states of the normal timeand the observation time, but the number of states is arbitrary. Forexample, switching may be performed among three or more states such as anormal time, a low-level observation time, an observation time, ahigh-level observation time, and the like. Here, an upper limit numberof states to be switched depends on the number of layers of scalableencoded data.

Further, the imaging device 1201 may decide the number of layers for thescalable coding according to a state. For example, during the normaltime, the imaging device 1201 may generate the scalable encoded data(BL) 1222 of the base layer having a small amount of data in a lowquality and provide the scalable encoded data (BL) 1222 of the baselayer to the scalable encoded data storage device 1202. Further, forexample, during the observation time, the imaging device 1201 maygenerate the scalable encoded data (BL+EL) 1221 of the base layer havinga large amount of data in a high quality and provide the scalableencoded data (BL+EL) 1221 of the base layer to the scalable encoded datastorage device 1202.

The above description has been made in connection with the example of amonitoring camera, but the purpose of the imaging system 1200 isarbitrary and not limited to a monitoring camera.

Tenth Embodiment Other Embodiments

The above embodiments have been described in connection with the exampleof the device, the system, or the like according to the presenttechnology, but the present technology is not limited to the aboveexamples and may be implemented as any component mounted in the deviceor the device configuring the system, for example, a processor servingas a system (large scale integration) LSI or the like, a module using aplurality of processors or the like, a unit using a plurality of modulesor the like, a set (that is, some components of the device) in which anyother function is further added to a unit, or the like.

(Exemplary Configuration of Video Set)

An example in which the present technology is implemented as a set willbe described with reference to FIG. 41. FIG. 41 illustrates an exemplaryschematic configuration of a video set to which the present technologyis applied.

In recent years, functions of electronic devices have become diverse,and when some components are implemented as sale, provision, or the likein development or manufacturing, there are many cases in which aplurality of components having relevant functions are combined andimplemented as a set having a plurality of functions as well as cases inwhich an implementation is performed as a component having a singlefunction.

A video set 1300 illustrated in FIG. 41 is a multi-functionalizedconfiguration in which a device having a function related to imageencoding and/or image decoding is combined with a device having anyother function related to the function.

As illustrated in FIG. 41, the video set 1300 includes a module groupsuch as a video module 1311, an external memory 1312, a power managementmodule 1313, and a front end module 1314 and a device having relevantfunctions such as a connectivity 1321, a camera 1322, and a sensor 1323.

A module is a part having multiple functions into which several relevantpart functions are integrated. A concrete physical configuration isarbitrary, but, for example, it is configured such that a plurality ofprocesses having respective functions, electronic circuit elements suchas a resistor and a capacitor, and other devices are arranged andintegrated on a wiring substrate. Further, a new module may be obtainedby combining another module or a processor with a module.

In the case of the example of FIG. 41, the video module 1311 is acombination of components having functions related to image processing,and includes an application processor, a video processor, a broadbandmodem 1333, and a radio frequency (RF) module 1334.

A processor is one in which a configuration having a certain function isintegrated into a semiconductor chip through System On a Chip (SoC), andalso refers to, for example, a system LSI (Large Scale Integration) orthe like. The configuration having the certain function may be a logiccircuit (hardware configuration), may be a CPU, a ROM, a RAM, and aprogram (software configuration) executed using the CPU, the ROM, andthe RAM, and may be a combination of a hardware configuration and asoftware configuration. For example, a processor may include a logiccircuit, a CPU, a ROM, a RAM, and the like, some functions may beimplemented through the logic circuit (hardware component), and theother functions may be implemented through a program (softwarecomponent) executed by the CPU.

The application processor 1331 of FIG. 41 is a processor that executesan application related to image processing. An application executed bythe application processor 1331 can not only perform a calculationprocess but also control components inside and outside the video module1311 such as the video processor 1332 as necessary in order to implementa certain function.

The video processor 1332 is a process having a function related to imageencoding and/or image decoding.

The broadband modem 1333 is a processor (or module) that performs aprocess related to wired and/or wireless broadband communication that isperformed via broadband line such as the Internet or a public telephoneline network. For example, the broadband modem 1333 converts data(digital signal) to be transmitted into an analog signal, for example,through digital modulation, demodulates a received analog signal, andconverts the analog signal into data (digital signal). For example, thebroadband modem 1333 can perform digital modulation and demodulation onarbitrary information such as image data processed by the videoprocessor 1332, a stream in which image data is encoded, an applicationprogram, or setting data.

The RF module 1334 is a module that performs a frequency transformprocess, a modulation/demodulation process, an amplification process, afiltering process, and the like on an radio frequency (RF) signaltransceived through an antenna. For example, the RF module 1334performs, for example, frequency transform on a baseband signalgenerated by the broadband modem 1333, and generates an RF signal.Further, for example, the RF module 1334 performs, for example,frequency transform on an RF signal received through the front endmodule 1314, and generates a baseband signal.

Further, a dotted line 1341, that is, the application processor 1331 andthe video processor 1332 may be integrated into a single processor asillustrated in FIG. 41.

The external memory 1312 is installed outside the video module 1311, anda module having a storage device used by the video module 1311. Thestorage device of the external memory 1312 can be implemented by anyphysical configuration, but is commonly used to store large capacitydata such as image data of frame units, and thus it is desirable toimplement the storage device of the external memory 1312 using arelative chip large-capacity semiconductor memory such as a dynamicrandom access memory (DRAM).

The power management module 1313 manages and controls power supply tothe video module 1311 (the respective components in the video module1311).

The front end module 1314 is a module that provides a front end function(a circuit of a transceiving end at an antenna side) to the RF module1334. As illustrated in FIG. 41, the front end module 1314 includes, forexample, an antenna unit 1351, a filter 1352, and an amplifying unit1353.

The antenna unit 1351 includes an antenna that transceives a radiosignal and a peripheral configuration. The antenna unit 1351 transmits asignal provided from the amplifying unit 1353 as a radio signal, andprovides a received radio signal to the filter 1352 as an electricalsignal (RF signal). The filter 1352 performs, for example, a filteringprocess on an RF signal received through the antenna unit 1351, andprovides a processed RF signal to the RF module 1334. The amplifyingunit 1353 amplifies the RF signal provided from the RF module 1334, andprovides the amplified RF signal to the antenna unit 1351.

The connectivity 1321 is a module having a function related to aconnection with the outside. A physical configuration of theconnectivity 1321 is arbitrary. For example, the connectivity 1321includes a configuration having a communication function other than acommunication standard supported by the broadband modem 1333, anexternal I/O terminal, or the like.

For example, the connectivity 1321 may include a module having acommunication function based on a wireless communication standard suchas Bluetooth (a registered trademark), IEEE 802.11 (for example,Wireless Fidelity (Wi-Fi) (a registered trademark)), Near FieldCommunication (NFC), InfraRed Data Association (IrDA), an antenna thattransceives a signal satisfying the standard, or the like. Further, forexample, the connectivity 1321 may include a module having acommunication function based on a wired communication standard such asUniversal Serial Bus (USB), or High-Definition Multimedia Interface(HDMI) (a registered trademark) or a terminal that satisfies thestandard. Furthermore, for example, the connectivity 1321 may includeany other data (signal) transmission function or the like such as ananalog I/O terminal.

Further, the connectivity 1321 may include a device of a transmissiondestination of data (signal). For example, the connectivity 1321 mayinclude a drive (including a hard disk, a solid state drive (SSD), aNetwork Attached Storage (NAS), or the like as well as a drive of aremovable medium) that reads/writes data from/in a recording medium suchas a magnetic disk, an optical disk, a magneto optical disk, or asemiconductor memory. Furthermore, the connectivity 1321 may include anoutput device (a monitor, a speaker, or the like) that outputs an imageor a sound.

The camera 1322 is a module having a function of photographing a subjectand obtaining image data of the subject. For example, image dataobtained by the photographing of the camera 1322 is provided to andencoded by the video processor 1332.

The sensor 1323 is a module having an arbitrary sensor function such asa sound sensor, an ultrasonic sensor, an optical sensor, an illuminancesensor, an infrared sensor, an image sensor, a rotation sensor, an anglesensor, an angular velocity sensor, a velocity sensor, an accelerationsensor, an inclination sensor, a magnetic identification sensor, a shocksensor, or a temperature sensor. For example, data detected by thesensor 1323 is provided to the application processor 1331 and used by anapplication or the like.

A configuration described above as a module may be implemented as aprocessor, and a configuration described as a processor may beimplemented as a module.

In the video set 1300 having the above configuration, the presenttechnology can be applied to the video processor 1332 as will bedescribed later. Thus, the video set 1300 can be implemented as a set towhich the present technology is applied.

(Exemplary Configuration of Video Processor)

FIG. 42 illustrates an exemplary schematic configuration of the videoprocessor 1332 (FIG. 41) to which the present technology is applied.

In the case of the example of FIG. 42, the video processor 1332 has afunction of receiving an input of a video signal and an audio signal andencoding the video signal and the audio signal according to a certainscheme and a function of decoding encoded video data and audio data, andreproducing and outputting a video signal and an audio signal.

The video processor 1332 includes a video input processing unit 1401, afirst image enlarging/reducing unit 1402, a second imageenlarging/reducing unit 1403, a video output processing unit 1404, aframe memory 1405, and a memory control unit 1406 as illustrated in FIG.42. The video processor 1332 further includes an encoding/decodingengine 1407, video elementary stream (ES) buffers 1408A and 1408B, andaudio ES buffers 1409A and 1409B. The video processor 1332 furtherincludes an audio encoder 1410, an audio decoder 1411, a multiplexingunit (multiplexer (MUX)) 1412, a demultiplexing unit (demultiplexer(DMUX)) 1413, and a stream buffer 1414.

For example, the video input processing unit 1401 acquires a videosignal input from the connectivity 1321 (FIG. 41) or the like, andconverts the video signal into digital image data. The first imageenlarging/reducing unit 1402 performs, for example, a format conversionprocess and an image enlargement/reduction process on the image data.The second image enlarging/reducing unit 1403 performs an imageenlargement/reduction process on the image data according to a format ofa destination to which the image data is output through the video outputprocessing unit 1404 or performs the format conversion process and theimage enlargement/reduction process which are identical to those of thefirst image enlarging/reducing unit 1402 on the image data. The videooutput processing unit 1404 performs format conversion and conversioninto an analog signal on the image data, and outputs a reproduced videosignal, for example, the connectivity 1321 (FIG. 41) or the like.

The frame memory 1405 is an image data memory that is shared by thevideo input processing unit 1401, the first image enlarging/reducingunit 1402, the second image enlarging/reducing unit 1403, the videooutput processing unit 1404, and the encoding/decoding engine 1407. Theframe memory 1405 is implemented as, for example, a semiconductor memorysuch as a DRAM.

The memory control unit 1406 receives a synchronous signal from theencoding/decoding engine 1407, and controls writing/reading access tothe frame memory 1405 according to an access schedule for the framememory 1405 written in an access management table 1406A. The accessmanagement table 1406A is updated through the memory control unit 1406according to processing executed by the encoding/decoding engine 1407,the first image enlarging/reducing unit 1402, the second imageenlarging/reducing unit 1403, or the like.

The encoding/decoding engine 1407 performs an encoding process ofencoding image data and a decoding process of decoding a video streamthat is data obtained by encoding image data. For example, theencoding/decoding engine 1407 encodes image data read from the framememory 1405, and sequentially writes the encoded image data in the videoES buffer 1408A as a video stream. Further, for example, theencoding/decoding engine 1407 sequentially reads the video stream fromthe video ES buffer 1408B, sequentially decodes the video stream, andsequentially the decoded image data in the frame memory 1405. Theencoding/decoding engine 1407 uses the frame memory 1405 as a workingarea at the time of the encoding or the decoding. Further, theencoding/decoding engine 1407 outputs the synchronous signal to thememory control unit 1406, for example, at a timing at which processingof each macro block starts.

The video ES buffer 1408A buffers the video stream generated by theencoding/decoding engine 1407, and then provides the video stream to themultiplexing unit (MUX) 1412. The video ES buffer 1408B buffers thevideo stream provided from the demultiplexing unit (DMUX) 1413, and thenprovides the video stream to the encoding/decoding engine 1407.

The audio ES buffer 1409A buffers an audio stream generated by the audioencoder 1410, and then provides the audio stream to the multiplexingunit (MUX) 1412. The audio ES buffer 1409B buffers an audio streamprovided from the demultiplexing unit (DMUX) 1413, and then provides theaudio stream to the audio decoder 1411.

For example, the audio encoder 1410 converts an audio signal input from,for example, the connectivity 1321 (FIG. 41) or the like into a digitalsignal, and encodes the digital signal according to a certain schemesuch as an MPEG audio scheme or an AudioCode number 3 (AC3) scheme. Theaudio encoder 1410 sequentially writes the audio stream that is dataobtained by encoding the audio signal in the audio ES buffer 1409A. Theaudio decoder 1411 decodes the audio stream provided from the audio ESbuffer 1409B, performs, for example, conversion into an analog signal,and provides a reproduced audio signal to, for example, the connectivity1321 (FIG. 41) or the like.

The multiplexing unit (MUX) 1412 performs multiplexing of the videostream and the audio stream. A multiplexing method (that is, a format ofa bitstream generated by multiplexing) is arbitrary. Further, at thetime of multiplexing, the multiplexing unit (MUX) 1412 may add certainheader information or the like to the bitstream. In other words, themultiplexing unit (MUX) 1412 may convert a stream format bymultiplexing. For example, the multiplexing unit (MUX) 1412 multiplexesthe video stream and the audio stream to be converted into a transportstream that is a bitstream of a transfer format. Further, for example,the multiplexing unit (MUX) 1412 multiplexes the video stream and theaudio stream to be converted into data (file data) of a recording fileformat.

The demultiplexing unit (DMUX) 1413 demultiplexes the bitstream obtainedby multiplexing the video stream and the audio stream by a methodcorresponding to the multiplexing performed by the multiplexing unit(MUX) 1412. In other words, the demultiplexing unit (DMUX) 1413 extractsthe video stream and the audio stream (separates the video stream andthe audio stream) from the bitstream read from the stream buffer 1414.In other words, the demultiplexing unit (DMUX) 1413 can performconversion (inverse conversion of conversion performed by themultiplexing unit (MUX) 1412) of a format of a stream through thedemultiplexing. For example, the demultiplexing unit (DMUX) 1413 canacquire the transport stream provided from, for example, theconnectivity 1321 or the broadband modem 1333 (both FIG. 41) through thestream buffer 1414 and convert the transport stream into a video streamand an audio stream through the demultiplexing. Further, for example,the demultiplexing unit (DMUX) 1413 can acquire file data read fromvarious kinds of recording media (FIG. 41) by, for example, theconnectivity 1321 through the stream buffer 1414 and converts the filedata into a video stream and an audio stream by the demultiplexing.

The stream buffer 1414 buffers the bitstream. For example, the streambuffer 1414 buffers the transport stream provided from the multiplexingunit (MUX) 1412, and provides the transport stream to, for example, theconnectivity 1321 or the broadband modem 1333 (both FIG. 41) at acertain timing or based on an external request or the like.

Further, for example, the stream buffer 1414 buffers file data providedfrom the multiplexing unit (MUX) 1412, provides the file data to, forexample, the connectivity 1321 (FIG. 41) or the like at a certain timingor based on an external request or the like, and causes the file data tobe recorded in various kinds of recording media.

Furthermore, the stream buffer 1414 buffers the transport streamacquired through, for example, the connectivity 1321 or the broadbandmodem 1333 (both FIG. 41), and provides the transport stream to thedemultiplexing unit (DMUX) 1413 at a certain timing or based on anexternal request or the like.

Further, the stream buffer 1414 buffers file data read from variouskinds of recording media in, for example, the connectivity 1321 (FIG.41) or the like, and provides the file data to the demultiplexing unit(DMUX) 1413 at a certain timing or based on an external request or thelike.

Next, an operation of the video processor 1332 having the aboveconfiguration will be described. The video signal input to the videoprocessor 1332, for example, from the connectivity 1321 (FIG. 41) or thelike is converted into digital image data according to a certain schemesuch as a 4:2:2 Y/Cb/Cr scheme in the video input processing unit 1401and sequentially written in the frame memory 1405. The digital imagedata is read out to the first image enlarging/reducing unit 1402 or thesecond image enlarging/reducing unit 1403, subjected to a formatconversion process of performing a format conversion into a certainscheme such as a 4:2:0 Y/Cb/Cr scheme and an enlargement/reductionprocess, and written in the frame memory 1405 again. The image data isencoded by the encoding/decoding engine 1407, and written in the videoES buffer 1408A as a video stream.

Further, an audio signal input to the video processor 1332 from theconnectivity 1321 (FIG. 41) or the like is encoded by the audio encoder1410, and written in the audio ES buffer 1409A as an audio stream.

The video stream of the video ES buffer 1408A and the audio stream ofthe audio ES buffer 1409A are read out to and multiplexed by themultiplexing unit (MUX) 1412, and converted into a transport stream,file data, or the like. The transport stream generated by themultiplexing unit (MUX) 1412 is buffered in the stream buffer 1414, andthen output to an external network through, for example, theconnectivity 1321 or the broadband modem 1333 (both FIG. 41). Further,the file data generated by the multiplexing unit (MUX) 1412 is bufferedin the stream buffer 1414, then output to, for example, the connectivity1321 (FIG. 41) or the like, and recorded in various kinds of recordingmedia.

Further, the transport stream input to the video processor 1332 from anexternal network through, for example, the connectivity 1321 or thebroadband modem 1333 (both FIG. 41) is buffered in the stream buffer1414 and then demultiplexed by the demultiplexing unit (DMUX) 1413.Further, the file data that is read from various kinds of recordingmedia in, for example, the connectivity 1321 (FIG. 41) or the like andthen input to the video processor 1332 is buffered in the stream buffer1414 and then demultiplexed by the demultiplexing unit (DMUX) 1413. Inother words, the transport stream or the file data input to the videoprocessor 1332 is demultiplexed into the video stream and the audiostream through the demultiplexing unit (DMUX) 1413.

The audio stream is provided to the audio decoder 1411 through the audioES buffer 1409B and decoded, and so an audio signal is reproduced.Further, the video stream is written in the video ES buffer 1408B,sequentially read out to and decoded by the encoding/decoding engine1407, and written in the frame memory 1405. The decoded image data issubjected to the enlargement/reduction process performed by the secondimage enlarging/reducing unit 1403, and written in the frame memory1405. Then, the decoded image data is read out to the video outputprocessing unit 1404, subjected to the format conversion process ofperforming format conversion to a certain scheme such as a 4:2:2 Y/Cb/Crscheme, and converted into an analog signal, and so a video signal isreproduced.

When the present technology is applied to the video processor 1332having the above configuration, it is preferable that the aboveembodiments of the present technology be applied to theencoding/decoding engine 1407. In other words, for example, theencoding/decoding engine 1407 preferably has the function of theencoding device or the decoding device according to the firstembodiment. Accordingly, the video processor 1332 can obtain the sameeffects as the effects described above with reference to FIGS. 1 to 12.

Further, in the encoding/decoding engine 1407, the present technology(that is, the functions of the image encoding devices or the imagedecoding devices according to the above embodiment) may be implementedby either or both of hardware such as a logic circuit or software suchas an embedded program.

(Another Exemplary Configuration of Video Processor)

FIG. 43 illustrates another exemplary schematic configuration of thevideo processor 1332 (FIG. 41) to which the present technology isapplied. In the case of the example of FIG. 43, the video processor 1332has a function of encoding and decoding video data according to acertain scheme.

More specifically, the video processor 1332 includes a control unit1511, a display interface 1512, a display engine 1513, an imageprocessing engine 1514, and an internal memory 1515 as illustrated inFIG. 43. The video processor 1332 further includes a codec engine 1516,a memory interface 1517, a multiplexing/demultiplexing unit (MUX DMUX)1518, a network interface 1519, and a video interface 1520.

The control unit 1511 controls an operation of each processing unit inthe video processor 1332 such as the display interface 1512, the displayengine 1513, the image processing engine 1514, and the codec engine1516.

The control unit 1511 includes, for example, a main CPU 1531, a sub CPU1532, and a system controller 1533 as illustrated in FIG. 43. The mainCPU 1531 executes, for example, a program for controlling an operationof each processing unit in the video processor 1332. The main CPU 1531generates a control signal, for example, according to the program, andprovides the control signal to each processing unit (that is, controlsan operation of each processing unit). The sub CPU 1532 plays asupplementary role of the main CPU 1531. For example, the sub CPU 1532executes a child process or a subroutine of a program executed by themain CPU 1531. The system controller 1533 controls operations of themain CPU 1531 and the sub CPU 1532, for examples, designates a programexecuted by the main CPU 1531 and the sub CPU 1532.

The display interface 1512 outputs image data to, for example, theconnectivity 1321 (FIG. 41) or the like under control of the controlunit 1511. For example, the display interface 1512 converts image dataof digital data into an analog signal, and outputs the analog signal to,for example, the monitor device of the connectivity 1321 (FIG. 41) as areproduced video signal or outputs the image data of the digital datato, for example, the monitor device of the connectivity 1321 (FIG. 41).

The display engine 1513 performs various kinds of conversion processessuch as a format conversion process, a size conversion process, and acolor gamut conversion process on the image data under control of thecontrol unit 1511 to comply with, for example, a hardware specificationof the monitor device that displays the image.

The image processing engine 1514 performs certain image processing suchas a filtering process for improving an image quality on the image dataunder control of the control unit 1511.

The internal memory 1515 is a memory that is installed in the videoprocessor 1332 and shared by the display engine 1513, the imageprocessing engine 1514, and the codec engine 1516. The internal memory1515 is used for data transfer performed among, for example, the displayengine 1513, the image processing engine 1514, and the codec engine1516. For example, the internal memory 1515 stores data provided fromthe display engine 1513, the image processing engine 1514, or the codecengine 1516, and provides the data to the display engine 1513, the imageprocessing engine 1514, or the codec engine 1516 as necessary (forexample, according to a request). The internal memory 1515 can beimplemented by any storage device, but since the internal memory 1515 ismostly used for storage of small-capacity data such as image data ofblock units or parameters, it is desirable to implement the internalmemory 1515 using a semiconductor memory that is relatively small incapacity (for example, compared to the external memory 1312) and fast inresponse speed such as a static random access memory (SRAM).

The codec engine 1516 performs processing related to encoding anddecoding of image data. An en coding/decoding scheme supported by thecodec engine 1516 is arbitrary, and one or more schemes may be supportedby the codec engine 1516. For example, the codec engine 1516 may have acodec function of supporting a plurality of encoding/decoding schemesand perform encoding of image data or decoding of encoded data using ascheme selected from among the schemes.

In the example illustrated in FIG. 43, the codec engine 1516 includes,for example, an MPEG-2 Video 1541, an AVC/H.264 1542, a HEVC/H.265 1543,a HEVC/H.265 (Scalable) 1544, a HEVC/H.265 (Multi-view) 1545, and anMPEG-DASH 1551 as functional blocks of processing related to a codec.

The MPEG-2 Video 1541 is a functional block of encoding or decodingimage data according to an MPEG-2 scheme. The AVC/H.264 1542 is afunctional block of encoding or decoding image data according to an AVCscheme. The HEVC/H.265 1543 is a functional block of encoding ordecoding image data according to a HEVC scheme. The HEVC/H.265(Scalable) 1544 is a functional block of performing scalable encoding orscalable decoding on image data according to a HEVC scheme. TheHEVC/H.265 (Multi-view) 1545 is a functional block of performingmulti-view encoding or multi-view decoding on image data according to aHEVC scheme.

The MPEG-DASH 1551 is a functional block of transmitting and receivingimage data according to an MPEG-Dynamic Adaptive Streaming over HTTP(MPEG-DASH). The MPEG-DASH is a technique of streaming a video using aHyperText Transfer Protocol (HTTP), and has a feature of selectingappropriate one from among a plurality of pieces of encoded data thatdiffer in a previously prepared resolution or the like in units ofsegments and transmitting a selected one. The MPEG-DASH 1551 performsgeneration of a stream complying with a standard, transmission controlof the stream, and the like, and uses the MPEG-2 Video 1541 or theHEVC/H.265 (Multi-view) 1545 for encoding and decoding of image data.

The memory interface 1517 is an interface for the external memory 1312.Data provided from the image processing engine 1514 or the codec engine1516 is provided to the external memory 1312 through the memoryinterface 1517. Further, data read from the external memory 1312 isprovided to the video processor 1332 (the image processing engine 1514or the codec engine 1516) through the memory interface 1517.

The multiplexing/demultiplexing unit (MUX DMUX) 1518 performsmultiplexing and demultiplexing of various kinds of data related to animage such as a bitstream of encoded data, image data, and a videosignal. The multiplexing/demultiplexing method is arbitrary. Forexample, at the time of multiplexing, the multiplexing/demultiplexingunit (MUX DMUX) 1518 can not only combine a plurality of data into onebut also add certain header information or the like to the data.Further, at the time of demultiplexing, the multiplexing/demultiplexingunit (MUX DMUX) 1518 can not only divide one data into a plurality ofdata but also add certain header information or the like to each divideddata. In other words, the multiplexing/demultiplexing unit (MUX DMUX)1518 can converts a data format through multiplexing and demultiplexing.For example, the multiplexing/demultiplexing unit (MUX DMUX) 1518 canmultiplex a bitstream to be converted into a transport stream serving asa bitstream of a transfer format or data (file data) of a recording fileformat. Of course, inverse conversion can be also performed throughdemultiplexing.

The network interface 1519 is an interface for, for example, thebroadband modem 1333 or the connectivity 1321 (both FIG. 41). The videointerface 1520 is an interface for, for example, the connectivity 1321or the camera 1322 (both FIG. 41).

Next, an exemplary operation of the video processor 1332 will bedescribed. For example, when the transport stream is received from theexternal network through, for example, the connectivity 1321 or thebroadband modem 1333 (both FIG. 41), the transport stream is provided tothe multiplexing/demultiplexing unit (MUX DMUX) 1518 through the networkinterface 1519, demultiplexed, and then decoded by the codec engine1516. Image data obtained by the decoding of the codec engine 1516 issubjected to certain image processing performed, for example, by theimage processing engine 1514, subjected to certain conversion performedby the display engine 1513, and provided to, for example, theconnectivity 1321 (FIG. 41) or the like through the display interface1512, and so the image is displayed on the monitor. Further, forexample, image data obtained by the decoding of the codec engine 1516 isencoded by the codec engine 1516 again, multiplexed by themultiplexing/demultiplexing unit (MUX DMUX) 1518 to be converted intofile data, output to, for example, the connectivity 1321 (FIG. 41) orthe like through the video interface 1520, and then recorded in variouskinds of recording media.

Furthermore, for example, file data of encoded data obtained by encodingimage data read from a recording medium (not illustrated) through theconnectivity 1321 (FIG. 41) or the like is provided to themultiplexing/demultiplexing unit (MUX DMUX) 1518 through the videointerface 1520, and demultiplexed, and decoded by the codec engine 1516.Image data obtained by the decoding of the codec engine 1516 issubjected to certain image processing performed by the image processingengine 1514, subjected to certain conversion performed by the displayengine 1513, and provided to, for example, the connectivity 1321 (FIG.41) or the like through the display interface 1512, and so the image isdisplayed on the monitor. Further, for example, image data obtained bythe decoding of the codec engine 1516 is encoded by the codec engine1516 again, multiplexed by the multiplexing/demultiplexing unit (MUXDMUX) 1518 to be converted into a transport stream, provided to, forexample, the connectivity 1321 or the broadband modem 1333 (both FIG.41) through the network interface 1519, and transmitted to anotherdevice (not illustrated).

Further, transfer of image data or other data between the processingunits in the video processor 1332 is performed, for example, using theinternal memory 1515 or the external memory 1312. Furthermore, the powermanagement module 1313 controls, for example, power supply to thecontrol unit 1511.

When the present technology is applied to the video processor 1332having the above configuration, it is desirable to apply the aboveembodiments of the present technology to the codec engine 1516. In otherwords, for example, it is preferable that the codec engine 1516 have afunctional block of implementing the encoding device and the decodingdevice according to the first embodiment. Furthermore, for example, asthe codec engine 1516 operates as described above, the video processor1332 can have the same effects as the effects described above withreference to FIGS. 1 to 12.

Further, in the codec engine 1516, the present technology (that is, thefunctions of the image encoding devices or the image decoding devicesaccording to the above embodiment) may be implemented by either or bothof hardware such as a logic circuit or software such as an embeddedprogram.

The two exemplary configurations of the video processor 1332 have beendescribed above, but the configuration of the video processor 1332 isarbitrary and may have any configuration other than the above twoexemplary configuration. Further, the video processor 1332 may beconfigured with a single semiconductor chip or may be configured with aplurality of semiconductor chips. For example, the video processor 1332may be configured with a three-dimensionally stacked LSI in which aplurality of semiconductors are stacked. Further, the video processor1332 may be implemented by a plurality of LSIs.

(Application Examples to Devices)

The video set 1300 may be incorporated into various kinds of devicesthat process image data. For example, the video set 1300 may beincorporated into the television device 900 (FIG. 34), the mobiletelephone 920 (FIG. 35), the recording/reproducing device 940 (FIG. 36),the imaging device 960 (FIG. 37), or the like. As the video set 1300 isincorporated, the devices can have the same effects as the effectsdescribed above with reference to FIGS. 1 to 12.

Further, the video set 1300 may be also incorporated into a terminaldevice such as the personal computer 1004, the AV device 1005, thetablet device 1006, or the mobile telephone 1007 in the datatransmission system 1000 of FIG. 38, the broadcasting station 1101 orthe terminal device 1102 in the data transmission system 1100 of FIG.39, or the imaging device 1201 or the scalable encoded data storagedevice 1202 in the imaging system 1200 of FIG. 40. As the video set 1300is incorporated, the devices can have the same effects as the effectsdescribed above with reference to FIGS. 1 to 12.

Further, even each component of the video set 1300 can be implemented asa component to which the present technology is applied when thecomponent includes the video processor 1332. For example, only the videoprocessor 1332 can be implemented as a video processor to which thepresent technology is applied. Further, for example, the processorsindicated by the dotted line 1341 as described above, the video module1311, or the like can be implemented as, for example, a processor or amodule to which the present technology is applied. Further, for example,a combination of the video module 1311, the external memory 1312, thepower management module 1313, and the front end module 1314 can beimplemented as a video unit 1361 to which the present technology isapplied. These configurations can have the same effects as the effectsdescribed above with reference to FIGS. 1 to 12.

In other words, a configuration including the video processor 1332 canbe incorporated into various kinds of devices that process image data,similarly to the case of the video set 1300. For example, the videoprocessor 1332, the processors indicated by the dotted line 1341, thevideo module 1311, or the video unit 1361 can be incorporated into thetelevision device 900 (FIG. 34), the mobile telephone 920 (FIG. 35), therecording/reproducing device 940 (FIG. 36), the imaging device 960 (FIG.37), the terminal device such as the personal computer 1004, the AVdevice 1005, the tablet device 1006, or the mobile telephone 1007 in thedata transmission system 1000 of FIG. 38, the broadcasting station 1101or the terminal device 1102 in the data transmission system 1100 of FIG.39, the imaging device 1201 or the scalable encoded data storage device1202 in the imaging system 1200 of FIG. 40, or the like. Further, as theconfiguration to which the present technology is applied, the devicescan have the same effects as the effects described above with referenceto FIGS. 1 to 12, similarly to the video set 1300.

In the present disclosure, the description has been made in connectionwith the example in which various kinds of information such as the colorgamut information and the luminance information is multiplexed intoencoded data and transmitted from an encoding side to a decoding side.However, the technique of transmitting the information is not limited tothis example. For example, the information may be transmitted orrecorded as individual data associated with encoded data without beingmultiplexed into encoded data. Here, a term “associated” means that animage (or a part of an image such as a slice or a block) included in abitstream can be linked with information corresponding to the image atthe time of decoding. In other words, the information may be transmittedthrough a transmission path different from encoded data. Further, theinformation may be recorded in a recording medium (or a differentrecording area of the same recording medium) different from encodeddata. Furthermore, the information and the encoded data may beassociated with each other, for example, in units of a plurality offrames, frames, or arbitrary units such as parts of a frame.

In the present disclosure, a system represents a set of a plurality ofcomponents (devices, modules (parts), and the like), and all componentsneed not be necessarily arranged in a single housing. Thus, both aplurality of devices that are arranged in individual housings andconnected with one another via a network and a single device including aplurality of modules arranged in a single housing are regarded as asystem.

The effects described in the present disclosure are merely examples, andother effects may be obtained.

Further, an embodiment of the present disclosure is not limited to theabove embodiments, and various changes can be made within a scope notdeparting from the gist of the present disclosure.

For example, the present disclosure may have a cloud computingconfiguration in which one function is shared and jointly processed by aplurality of devices via a network.

The steps described above with reference to the flowchart may beperformed by a single device or may be shared and performed by aplurality of devices.

Furthermore, when a plurality of processes are included in a singlestep, the plurality of processes included in the single step may beperformed by a single device or may be shared and performed by aplurality of devices.

The present disclosure can have the following configurations as well.

(1)

A decoding device, including:

a receiving unit that receives an encoded stream including encoded dataof an image and color gamut information indicating a color gamut of theimage from an encoding device that transmits the encoded stream;

an extracting unit that extracts the encoded data and the color gamutinformation from the encoded stream received by the receiving unit; and

a decoding unit that decodes the encoded data extracted by theextracting unit, and generates the image.

(2)

The decoding device according to (1), further including

an adjusting unit that adjusts the color gamut of the image generated bythe decoding unit based on the color gamut information extracted by theextracting unit.

(3)

The decoding device according to (2),

wherein the encoded stream includes luminance information indicatingluminance of a display unit that displays the image at a time ofauthoring of the image,

the extracting unit extracts the luminance information from the encodedstream, and

the adjusting unit adjusts a luminance dynamic range of the imagegenerated by the decoding unit based on the luminance informationextracted by the extracting unit.

(4)

The decoding device according to (3),

wherein the luminance information indicates luminance of white and blackof the display unit.

(5)

A decoding method performed by a decoding device, including:

a receiving step of receiving an encoded stream including encoded dataof an image and color gamut information indicating a color gamut of theimage from an encoding device that transmits the encoded stream;

an extracting step of extracting the encoded data and the color gamutinformation from the encoded stream received in the receiving step; and

a decoding step of decoding the encoded data extracted in the extractingstep and generating the image.

(6)

An encoding device, including:

an encoding unit that encodes an image, and generates encoded data;

a setting unit that sets color gamut information indicating a colorgamut of the image; and

a transmitting unit that transmits an encoded stream including theencoded data generated by the encoding unit and the color gamutinformation generated by the setting unit.

(7)

The encoding device according to (6),

wherein the setting unit sets luminance information indicating luminanceof a display unit that displays the image at a time of authoring of theimage, and

the transmitting unit transmits an encoded stream including the encodeddata, the color gamut information, and the luminance information.

(8)

The encoding device according to (7),

wherein the luminance information indicates luminance of white and blackof the display unit.

(9)

An encoding method performed by an encoding device, including:

an encoding step of encoding an image and generating encoded data;

a setting step of setting color gamut information indicating a colorgamut of the image; and

a transmitting step of transmitting an encoded stream including theencoded data generated in the encoding step and the color gamutinformation generated in the setting step.

(10)

A decoding device, including:

a receiving unit that receives an encoded stream including encoded dataof an image, identification information identifying a certain colorgamut, and a cover ratio of a color gamut of the image to the certaincolor gamut from an encoding device that transmits the encoded stream;

an extracting unit that extracts the encoded data, the identificationinformation, and the cover ratio from the encoded stream received by thereceiving unit; and

a decoding unit that decodes the encoded data extracted by theextracting unit, and generates the image.

(11)

The decoding device according to (10), further including

an adjusting unit that adjusts the color gamut of the image generated bythe decoding unit based on the identification information and the coverratio extracted by the extracting unit.

(12)

The decoding device according to (11),

wherein the encoded stream includes luminance information indicatingluminance of a display unit that displays the image at a time ofauthoring of the image,

the extracting unit extracts the luminance information from the encodedstream, and

the adjusting unit adjusts a luminance dynamic range of the imagegenerated by the decoding unit based on the luminance informationextracted by the extracting unit.

(13)

The decoding device according to (12),

wherein the luminance information indicates luminance of white and blackof the display unit.

(14)

A decoding method performed by a decoding device, including:

a receiving step of receiving an encoded stream including encoded dataof an image, identification information identifying a certain colorgamut, and a cover ratio of a color gamut of the image to the certaincolor gamut from an encoding device that transmits the encoded stream;

an extracting step of extracting the encoded data, the identificationinformation, and the cover ratio from the encoded stream received in thereceiving step; and

a decoding step of decoding the encoded data extracted in the extractingstep and generating the image.

(15)

An encoding device, including:

an encoding unit that encodes an image, and generates encoded data;

a setting unit that sets identification information identifying acertain color gamut and a cover ratio of a color gamut of the image tothe certain color gamut; and

a transmitting unit that transmits an encoded stream including theencoded data generated by the encoding unit and the identificationinformation and the cover ratio generated by the setting unit.

(16)

The encoding device according to (15),

wherein the setting unit sets luminance information indicating luminanceof a display unit that displays the image at a time of authoring of theimage, and

the transmitting unit transmits an encoded stream including the encodeddata, the color gamut information, and the luminance information.

(17)

The encoding device according to (16),

wherein the luminance information indicates luminance of white and blackof the display unit.

(18)

An encoding method performed by an encoding device, including:

an encoding step of encoding an image and generating encoded data;

a setting step of setting identification information identifying acertain color gamut and a cover ratio of a color gamut of the image tothe certain color gamut; and

a transmitting step of transmitting an encoded stream including theencoded data generated in the encoding step and the identificationinformation and the cover ratio generated in the setting step.

(19)

A decoding device, including:

circuitry configured to

-   -   receive an encoded stream including encoded data of an image and        color primary information indicating a coordinate of at least        one color primary of the image;    -   extract the encoded data and the color primary information from        the received encoded stream;    -   decode the extracted encoded data to generate the image; and    -   adjust a color space of the generated image based on the        extracted color primary information.        (20)

The decoding device according to (19), wherein the circuitry is furtherconfigured to

receive white information indicating a coordinate of a white point in apredetermined color space.

(21)

The decoding device according to (19) or (20), wherein the color primaryinformation includes a plurality of coordinates color primaries.

(22)

The decoding device according to (21), wherein the plurality of colorprimaries includes red, green, and blue.

(23)

The decoding device according to any one of (19) to (22), wherein

the encoded stream includes luminance information indicating luminanceof a display unit that displays the image at a time of authoring of theimage, and

the circuitry is further configured to

-   -   extract the luminance information from the encoded stream, and    -   adjust a luminance dynamic range of the generated image based on        the extracted luminance information.        (24)

The decoding device according to (23),

wherein the luminance information indicates a plurality of luminancevalues of the display unit.

(25)

A decoding method performed by a decoding device, including:

receiving an encoded stream including encoded data of an image and colorprimary information indicating a coordinate of at least one colorprimary of the image;

extracting, by circuitry of the decoding device, the encoded data andthe color primary information from the received encoded stream;

decoding the extracted encoded data to generate the image; and

adjusting, by the circuitry, a color space of the generated image basedon the extracted color primary information.

(26)

The decoding method according to (25), further comprising:

receiving white information indicating a coordinate of a white point ina predetermined color space.

(27)

The decoding method according to (25) or (26), wherein the color primaryinformation includes a plurality of coordinates of color primaries.

(28)

The decoding method according to (27), wherein the plurality of colorprimaries includes red, green, and blue.

(29)

The decoding method according to any one of (25) to (28), wherein

the encoded stream includes luminance information indicating luminanceof a display unit that displays the image at a time of authoring of theimage, and

the method further comprises:

-   -   extracting the luminance information from the encoded stream,        and    -   adjusting a luminance dynamic range of the generated image based        on the extracted luminance information.        (30)

The decoding method according to (29),

wherein the luminance information indicates a plurality of luminancevalues of the display unit.

(31)

A non-transitory computer-readable medium having stored thereon:

an encoded stream including encoded data of an image and color primaryinformation indicating a coordinate of at least one color primary of theimage, wherein

a decoding device decodes the encoded data to generate the image, andadjusts a color space of the generated image based on the color primaryinformation.

(32)

The non-transitory computer-readable medium according to (31), whereinthe encoded stream includes white information indicating a coordinate ofa white point in a predetermined color space.

(33)

The non-transitory computer-readable medium according to (31) or (32),wherein the color primary information includes a plurality ofcoordinates color primaries.

(34)

The non-transitory computer-readable medium according to (33), whereinthe plurality of color primaries includes red, green, and blue.

(35)

The non-transitory computer-readable medium according to any one of (31)to (34), wherein

the encoded stream includes luminance information indicating luminanceof a display unit that displays the image at a time of authoring of theimage, and

the decoding device adjusts a luminance dynamic range of the generatedimage based on the extracted luminance information.

(36)

The non-transitory computer-readable medium according to (35),

wherein the luminance information indicates a plurality of luminancevalues of the display unit.

(37)

An encoding device, comprising:

circuitry configured to

-   -   encode an image;    -   generate encoded data;    -   set color primary information indicating a coordinate of at        least one color primary of the image; and    -   transmit an encoded stream including the generated encoded data        and the generated color primary information.        (38)

The encoding device according to (37), wherein the circuitry is furtherconfigured to

set white information indicating a coordinate of a white point in apredetermined color space.

(39)

The encoding device according to (37) or (38), wherein the color primaryinformation includes a plurality of coordinates of color primaries.

(40)

The encoding device according to (39), wherein the plurality of colorprimaries includes red, green, and blue.

(41)

The encoding device according to any one of (37) to (39), wherein thecircuitry is further configured to

set luminance information indicating luminance of a display unit thatdisplays the image at a time of authoring of the image, and

transmit the encoded stream including the encoded data, the colorprimary information, and the luminance information.

(42)

The encoding device according to claim (41),

wherein the luminance information indicates a plurality of luminancevalues of the display unit.

REFERENCE SIGNS LIST

-   10 Encoding device-   11 Setting unit-   12 Encoding unit-   13 Transmitting unit-   50 Decoding device-   51 Receiving unit-   52 Extracting unit-   53 Decoding unit-   54 Adjusting unit-   70 Encoding device-   72 Setting unit-   90 Decoding device-   91 Extracting unit-   92 Adjusting unit

The invention claimed is:
 1. A decoding device, comprising: processingcircuitry configured to receive encoded image data, color primaryinformation indicating coordinates of three color primaries, andluminance information indicating a first luminance of a master displayand a second luminance of the master display; decode the encoded imagedata to generate an image; and adjust a luminance of the generated imagebased on the luminance information.
 2. The decoding device according toclaim 1, wherein the processing, circuitry is further configured toadjust a dynamic range of the generated image based on the luminanceinformation.
 3. The decoding device according to claim 1, wherein thefirst luminance is higher than the second luminance.
 4. The decodingdevice according to claim 3, wherein the first luminance is a whiteluminance of the master display and the second luminance is a blackluminance of the master display.
 5. The decoding device according toclaim 1, wherein the processing circuitry is configured to adjust theluminance of the generated image based on the first luminance and thesecond luminance.
 6. The decoding device according to claim 1, whereinthe luminance information indicates a third luminance of the masterdisplay.
 7. The decoding device according to claim 6, wherein the thirdluminance is lower than the first luminance and higher than the secondluminance.
 8. A decoding method performed by a decoding device,comprising: receiving encoded image data, color primary informationindicating coordinates of three color primaries, and luminanceinformation indicating a first luminance of a master display and asecond luminance of the master display; decoding, by processingcircuitry of the decoding device, the encoded image data to generate animage; and adjusting, by the processing circuitry, a luminance of thegenerated image based on the luminance information.
 9. The decodingmethod according to claim 8, further comprising: adjusting a dynamicrange of the generated image based on the luminance information.
 10. Thedecoding method according to claim 8, wherein the first luminance ishigher than the second luminance.
 11. The decoding method according toclaim 10, wherein the first luminance is a white luminance of the masterdisplay and the second luminance is a black luminance of the masterdisplay.
 12. The decoding method according to claim 8, wherein the stepof adjusting comprises: adjusting the luminance of the generated imagebased on the first luminance and the second luminance.
 13. The decodingmethod according to claim 8, wherein the luminance information indicatesa third luminance of the master display.
 14. The decoding methodaccording to claim 13, wherein the third luminance is lower than thefirst luminance and higher than the second luminance.
 15. A displayapparatus, comprising: a display configured to display an image; andcircuitry configured to receive encoded image data, color primaryinformation indicating coordinates of three color primaries, andluminance information indicating a first luminance of another displayapparatus and a second luminance of the other display apparatus; decodethe encoded image data to generate the image; adjust a luminance of thegenerated image based on the received luminance information; and outputthe adjusted image to the display.
 16. The display apparatus accordingto claim 15, wherein the other display apparatus is a reference display.17. The display apparatus according to claim 15, wherein the otherdisplay apparatus is a master display.
 18. The display apparatusaccording to claim 15, rein the other display apparatus displayed theimage while the image was being edited.
 19. The display apparatusaccording to claim 15, wherein the processing circuitry is furtherconfigured to adjust a dynamic range of the generated image based on theluminance information.
 20. The display apparatus according to claim 15,wherein the first luminance is higher than the second luminance.
 21. Thedisplay apparatus according to claim 20, wherein the first luminance isa white luminance of the other display apparatus and the secondluminance is a black luminance of the other display apparatus.
 22. Thedisplay apparatus according to claim 15, wherein the processingcircuitry is configured to adjust the luminance of the generated imagebased on the first luminance and the second luminance.
 23. The displayapparatus according to claim 15, wherein the first luminance and thesecond luminance of the other display apparatus are represented incandelas per square meter.
 24. The display apparatus according to claim15, wherein the processing circuitry is further configured to receivewhite point information indicating a coordinate of a white point. 25.The display apparatus according to claim 15, wherein the luminanceinformation indicates a third luminance of the other display apparatus.26. The display apparatus according to claim 25, wherein the thirdluminance is lower than the first luminance and higher than the secondluminance.
 27. A decoding method performed by a display apparatus,comprising: receiving encoded image data, color primary informationindicating coordinates of three color primaries, and luminanceinformation indicating a first luminance of another display apparatusand a second luminance of the other display apparatus; decoding, byprocessing circuitry of the display apparatus, the encoded image data togenerate an image; adjusting, by the processing circuitry, luminance ofthe generated image based on the received luminance information; andoutputting the adjusted image to a display of the display apparatus fordisplay.
 28. The decoding method according to claim 27, wherein theother display apparatus is a reference display.
 29. The decoding methodaccording to claim 27, wherein the other display apparatus is a masterdisplay.
 30. The decoding method according to claim 27, wherein theother display apparatus displayed the image while the image was beingedited.
 31. The decoding method according to claim 27, furthercomprising: adjusting a dynamic range of the generated image based onthe luminance information.
 32. The decoding method according to claim27, wherein the first luminance is higher than the second luminance. 33.The decoding method according to claim 28, wherein the first luminanceis a white luminance of the other display apparatus and the secondluminance is a black luminance of the other display apparatus.
 34. Thedecoding method according to claim 27, wherein the step of adjustingcomprises: adjusting the luminance of the generated image based on thefirst luminance and the second luminance.
 35. The decoding methodaccording to claim 27, wherein the first luminance and the secondluminance of the other display apparatus are represented in candelas persquare meter.
 36. The decoding method according to claim 27, furthercomprising: receiving white point information indicating a coordinate ofa white point.
 37. The decoding method according to claim 27, whereinthe luminance information indicates a third luminance of the otherdisplay apparatus.
 38. The decoding method according to claim 37,wherein the third luminance is lower than the first luminance and higherthan the second luminance.